Topic 0: Deep Generative Models
What does "Generative" mean in Deep Generative Models?
"Generative" describes a class of statistical models that contrasts with discriminative models.
Informally:
-
Generative models can generate new data instances.
-
Discriminative models discriminate between different kinds of data instances.
Example: A generative model could generate new photos of animals that look like real animals, while a discriminative model could tell a dog from a cat.
More formally, given a set of data instances X and a set of labels Y:
-
Generative models capture the joint probability p(X, Y), or just p(X) if there are no labels.
-
Discriminative models capture the conditional probability p(Y | X).
What is the relation between Deep learning and Deep Generative Models?
Deep generative models are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions.
When trained successfully, we can use the DGM to estimate the likelihood of a given sample and to create new samples that are similar to samples from the unknown distribution.
Popular DGMs are
Generative Adversarial Networks (GANs)
Variational Autoencoders (VAEs)
Auto-regressive models
GANs
2014
2014
ConditionalGANs
2015
LAPGANs
2015
DCGANs
2016
BiGANs
2016
SGAN
2016
InfoGANs
2016
EBGAN
Auxilary
Classifier
GANs
2017
2017
Progressive GANs
2018
BigGANs
2019
SAGANs
2019
NRGANs
2019
AutoGANs
2020
Your
Local GANs
2020
MSG-GANs
A generative adversarial network (GAN) is a class of Machine learning frameworks designed by Ian Goodfellow and his colleagues in 2014
The main idea behind it is "Two neural networks contest with each other in a game (in the form of a zero-sum game, where one agent's gain is another agent's loss)".
GANs and its History:
Deep Generative Models
By Manideep Ladi cs20m036
Deep Generative Models
A (brief/partial) History of Deep Learning
