In this last lecture, we will discuss undirected generative models. Specifically we will look at the Restricted Boltzmann Machine and (to the extent that time permits) the Deep Boltzmann Machine.
Reference: (* = you are responsible for this material)
- *Sections 20.1 to 20.4.4 (inclusively) of the Deep Learning textbook.
- Sections 17.3-17.4 (MCMC, Gibbs), chap. 19 (Approximate Inference) of the Deep Learning textbook.