Deep Learning

An MIT Press book in preparation

Yoshua Bengio, Ian Goodfellow and Aaron Courville

Citing the book in preparation

To cite this book in preparation, please use the following bibtex entry:

@unpublished{Bengio-et-al-2015-Book,    title={Deep Learning},    author={Yoshua Bengio and Ian J. Goodfellow and Aaron Courville},    note={Book in preparation for MIT Press},    url={http://www.iro.umontreal.ca/~bengioy/dlbook},    year={2015}}

FAQ

• Can I get a PDF of this book?

  No, our contract with MIT Press forbids distribution of too easily copiedelectronic formats of the book.Google employees who would like a paper copy of the book can send Ian thename of the printer nearest their desk and he will send a print job to thatprinter containing as much of the book as you would like to read.

• Why are you using HTML format for the drafts?

  This format is a sort of weak DRM. It's intended to discourage unauthorized copying/editingof the book. Unfortunately, the conversion from PDF to HTML is not perfect, and some things likesubscript expressions do not render correctly. If you have a suggestion for a better way of makingthe book available to a wide audience while preventing unauthorized copies, please let us know.

• What is the best way to print the HTML format?

Printing seems to work best printing directly from the browser, using Chrome.

• When will the book come out?

  It's difficult to predict but we're doing our best to finish it as soon as possible.

Draft chapters available for feedback - Version 07/08/2015

Please help us make this a great book! This is still only a draft and can be improved in many ways. We've included our TODO marks to help you see which sections are still under rapid development. If you see a section that we appear to have finished writing and you find it unclear or inaccurate, please let us know. Please specify (by date) which version you are commenting on. Do not hesitate to contact any of the authors directly by e-mail or Google+ messages: Yoshua (<firstname>.<lastname>@umontreal.ca), Ian (<lastname>@google.com), Aaron (<firstname>.<lastname>@gmail.com).

• Table of Contents
• Acknowledgements
• Notation
• 1 Introduction
• Part I: Applied Math and Machine Learning Basics
• 2 Linear Algebra
• 3 Probability and Information Theory
• 4 Numerical Computation
• 5 Machine Learning Basics
• Part II: Modern Practical Deep Networks
• 6 Feedforward Deep Networks
• 7 Regularization
• 8 Optimization for Training Deep Models
• 9 Convolutional Networks
• 10 Sequence Modeling: Recurrent and Recursive Nets
• 12 Applications
• Part III: Deep Learning Research
• 13 Structured Probabilistic Models for Deep Learning
• 14 Monte Carlo Methods
• 15 Linear Factor Models and Auto-Encoders
• 16 Representation Learning
• 17 The Manifold Perspective on Representation Learning
• 18 Confronting the Partition Function
• 19 Approximate Inference
• 20 Deep Generative Models
• Bibliography
• Index

Older versions:

• Version 05-07-2015.
• Version 19-5-2015.
• Version 30-3-2015.
• Version 1-1-2015.
• Version 5-12-2014.
• Version 22-10-2014.