Carol Cuesta-Lazaro (IAIFI Fellow)
in collaboration with Siddarth Mishra-Sharma
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9859021/pasted-from-clipboard.png)
Generative models for the Large Scale Structure
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10485644/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10485645/pasted-from-clipboard.png)
Why Carol loves generative models and thinks you should love them too
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459797/pasted-from-clipboard.png)
Initial Conditions of the Universe
Laws of gravity
3-D distribution of galaxies
Which are the ICs of OUR Universe?
Primordial non-Gaussianity?
Probe Inflation
Galaxy formation
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459811/pasted-from-clipboard.png)
3-D distribution of dark matter
Is GR modified on large scales?
How do galaxies form?
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926201/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/6926200/pasted-from-clipboard.png)
Neutrino mass hierarchy?
ML for Large Scale Structure:
A wish list
Generative models
Learn p(x)
Evaluate the likelihood of a 3D map, as a function of the parameters of interest
1
Combine different galaxy properties (such as velocities and positions)
2
Sample 3D maps from the posterior distribution
3
![](https://newscenter.lbl.gov/wp-content/uploads/2022/01/allframe-1000mpc-960x540-1.gif)
"What I cannot create, I do not understand"
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436322/pasted-from-clipboard.png)
https://vitalflux.com/generative-vs-discriminative-models-examples/
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436322/pasted-from-clipboard.png)
Hall of fame
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436057/pasted-from-clipboard.png)
A teddy bear wearing a motorcycle helmet and cape is standing in front of Loch Awe with Kilchurn Castle behind him driving a speed boat near the Golden Gate Bridge
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436060/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10436056/pasted-from-clipboard.png)
https://parti.research.google
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10435183/pasted-from-clipboard.png)
Emulators of complex processes
![](https://d3i71xaburhd42.cloudfront.net/5cf3323c334a1c47da20c52f076cdd183aaa0ef4/8-Figure3-1.png)
Anomaly detection
arXiv:2010.11202
Estimating non-gaussian likelihoods
Model posterior distributions (uncertainties)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597012/Screenshot_2023-07-04_at_5.53.25_PM.png)
arXiv:2304.03788
Explicit Density
Implicit Density
Tractable Density
Approximate Density
Normalising flows
Variational Autoencoders
Diffusion models
Generative Adversarial Networks
The zoo of generative models
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
Reverse diffusion: Denoise previous step
Forward diffusion: Add Gaussian noise (fixed)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10464337/pasted-from-clipboard.png)
Diffusion models
A person half Yoda half Gandalf
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245028/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245033/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Diffusion on 3D coordinates
Reverse diffusion: Denoise previous step
Forward diffusion: Add Gaussian noise (fixed)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Cosmology
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459369/ezgif.com-resize.gif)
![](https://github.com/smsharma/set-diffuser/blob/main/notebooks/plots/animation_both_norotate.gif?raw=true)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10459309/knn-2.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10499434/velocity_summaries.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10499435/summaries.png)
Density PDF
kNN
TPCF
Halo Mass Function
Velocity
Mean pairwise velocity
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245028/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245033/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Evidence Lower Bound (ELBO)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10245034/pasted-from-clipboard.png)
Variational Inference
Approximate the true posterior of the latent variables by a parametric distribution
Evidence Lower Bound
Distance to true posterior
Find
1. ELBO is a lower bound of the evidence
2. Maximising ELBO = Minimising KL
Maximise ELBO to maximise ev/likelihood
Maximise ELBO to approximate true posterior
Setting tight constraints with only 5000 halo positions
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597125/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597130/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9947274/pasted-from-clipboard.png)
+ Galaxy formation
+ Observational systematics (Cut-sky, Fiber collisions)
+ Lightcone, Redshift Space Distortions....
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9947316/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9947325/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9947338/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9947349/pasted-from-clipboard.png)
Forward Model
N-body simulations
Observations
SIMBIG arXiv:2211.00723
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247973/imgbin_morpheus-the-matrix-neo-red-pill-and-blue-pill-youtube-png.png)
We can simulate the observable Universe, we just need hydrodynamical simulations
What are subresolution models?
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247916/pngwing.com.png)
Super massive black hole seeding in dark matter halos
BH feedback impacts galactic scales
Black holes can also grow through mergers
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247916/pngwing.com.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247916/pngwing.com.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247916/pngwing.com.png)
Effective models of astrophysical processes needed due to limited numerical resolutions or limited physical models
they can even teleport!
![](https://www.transparentpng.com/thumb/sad-emoji/acHAUx-sad-emoji-transparent.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597309/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597309/pasted-from-clipboard.png)
Particle Mesh to N-body
arXiv:2207.05509
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597322/Screenshot_2023-07-04_at_8.23.17_PM.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597322/Screenshot_2023-07-04_at_8.23.17_PM.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597306/unnamed.png)
Low Res Potential
True Potential
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597307/unnamed-2.png)
Corrected Potential
True Potential
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10247973/imgbin_morpheus-the-matrix-neo-red-pill-and-blue-pill-youtube-png.png)
We can't model galaxy formation, how do we make our models robust?
Increase the evidence of the observations
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10248428/pasted-from-clipboard.png)
Robust Summarisation
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/10597339/pasted-from-clipboard.png)
What ML can do for cosmology
- ML to accelerate non-linear predictions and density estimation
- Can ML extract **all** the information that there is at the field-level in the non-linear regime?
- Compare data and simulations, point us to the missing pieces?
cuestalz@mit.edu
![](https://s3.amazonaws.com/media-p.slid.es/uploads/993552/images/9860795/pasted-from-clipboard.png)
Graph Neural Networks in a nutshell
edge embedding
node embedding
Invariance vs Equivariance
Invariance
Scalar interactions
Equivariance
What can we do with vectors?
Tensor products
Node features
Edge features
edge embedding
node embedding
Input
noisy halo properties
Output
noise prediction
Copy of Copy of deck
By carol cuesta
Copy of Copy of deck
- 179