![](https://iaifi.org/images/iaifi-fullname-logo-black.png)
Generative Models in Astrophysics
Carol Cuesta-Lazaro
IAIFI Fellow
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10485644/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10485645/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459797/pasted-from-clipboard.png)
Initial Conditions of the Universe
Laws of gravity
3-D distribution of galaxies
Which are the ICs of OUR Universe?
Primordial non-Gaussianity?
Probe Inflation
Galaxy formation
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459811/pasted-from-clipboard.png)
3-D distribution of dark matter
Is GR modified on large scales?
How do galaxies form?
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926200/pasted-from-clipboard.png)
Neutrino mass hierarchy?
Dall-e 3
![](https://images.openai.com/blob/b196df3a-6fea-4d86-87b2-f9bb50be64c7/leaf.png?trim=0,0,0,0&width=2600)
![](https://cdn-icons-png.flaticon.com/512/1793/1793332.png)
A 2D animation of a folk music band composed of anthropomorphic autumn leaves, each playing traditional bluegrass instruments, amidst a rustic forest setting dappled with the soft light of a harvest moon
Emulate complex processes in high dimensions
![](https://scitechdaily.com/images/The-IllustrisTNG-Simulations.jpg)
arXiv:2206.04594
Generative AI for physics
Super resolution
![](https://yueyingn.github.io/assets/img/work/SRS-3D.png)
arxiv:2010.06608
Generative AI for physics
Compare data and simulations optimally
Simulation-based Inference
![](https://pbs.twimg.com/media/Fip9la7XgAA5OxG.jpg:large)
arXiv:1911.01429
Generative AI for physics
Detect anomalies
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10707662/pasted-from-clipboard.png)
arxiv:2010.14554
Generative AI for physics
Model uncertainties
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10707667/cubes.jpg)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10707667/cubes.jpg)
arxiv:2010.14554
Current Universe
Initial Conditions
Generative AI for physics
Represent complex priors
arxiv:2206.14820
![](https://raw.githubusercontent.com/smsharma/lensing-neural-fields/master/paper/arXiv-v1/figures/hig.png)
![](https://raw.githubusercontent.com/smsharma/lensing-neural-fields/master/paper/arXiv-v1/figures/hig.png)
how does a galaxy look like?
lensing
Generative AI for physics
![](https://creazilla-store.fra1.digitaloceanspaces.com/cliparts/78147/genie-lamp-clipart-xl.png)
Data
A parametric PDF
Maximise the likelihood
(or something similar)
Generative AI for physics
2. Sample
![](https://scitechdaily.com/images/The-IllustrisTNG-Simulations.jpg)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436327/pasted-from-clipboard.png)
1. Estimate densities
Explicit Density
Implicit Density
Tractable Density
Approximate Density
Normalising flows
Variational Autoencoders
Diffusion models
Generative Adversarial Networks
The zoo of generative models
The backbone of vision generative models
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
Reverse diffusion: Denoise previous step
Forward diffusion: Add Gaussian noise (fixed)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
A person half Yoda half Gandalf
Diffusion Models
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245028/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245033/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Diffusion on point clouds
Reverse diffusion: Denoise previous step
Forward diffusion: Add Gaussian noise (fixed)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Cosmology
![](https://github.com/smsharma/set-diffuser/blob/main/notebooks/plots/animation_both_norotate.gif?raw=true)
"Diffusion generative modeling for galaxy surveys: emulating clustering for inference at the field level" Carolina Cuesta-Lazaro, Siddarth Mishra-Sharma
Generating galaxy point clouds for redshift surveys
Setting tight constraints with only 5000 halo positions
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597125/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10499434/velocity_summaries.png)
Halo Mass Function
Velocity
Mean pairwise velocity
(Probabilistic) reconstruction of Dark Matter
"Probabilistic Reconstruction of Dark Matter fields from galaxies using diffusion models" Victoria Ono, Core Francisco Park, Nayantara Mudur, Yueying Ni, Carolina Cuesta-Lazaro (in prep)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10824461/fiducial_imshows-1.png)
(Probabilistic) reconstruction of Dark Matter
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10824461/fiducial_imshows-1.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10824461/fiducial_imshows-1.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10824460/fiducial_summaries-1.png)
(Probabilistic) reconstruction of Dark Matter
(Probabilistic) reconstruction of Dark Matter
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10807572/ASN1-illustration.png)
"Probabilistic Reconstruction of Dark Matter fields from galaxies using diffusion models" Victoria Ono, Core Francisco Park, Nayantara Mudur, Yueying Ni, Carolina Cuesta-Lazaro (in prep)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10812245/densities-1.png)
Differentiable PM Simulators
Node features coordinates (+mass, velocities)
Input
Noisy halo properties
Output
Noise prediction
Graph Neural Networks as score models
kNN (~20)
deck
By carol cuesta
deck
- 155