Data Products

world public!

world public

data right holders

Astronomy meets Data Science

We study rare and unusual transients with machine learning and probabilistic inference

Rubin LSST

Leading the Rubin LSST army of volunteers

FASTLab projects in data-driven astrophysics

At the intersection of astrophysics and Public Policy: From Light Echoes to Pollution Plumes

Data skills for good: COVID response support in Delaware

Time domain astrophysics at a glance

Olague et al 2017

@akumadog

Brain Programming and the Random Search in Object Categorization

Convolutional NN

The visual cortex learns hierarchically: first detects simple features, then more complex features and ensembles of features

The visual cortex learns hierarchically: first detects simple features, then more complex features and ensembles of features

Convolutional NN

https://www.kdnuggets.com/2016/11/intuitive-explanation-convolutional-neural-networks.html/2

multilayer perceptron

output

input layer

hidden layer

output layer

1970: multilayer perceptron architecture

Defines a 5-fold metric to evaluate completeness of LSST observations along features relevant to transients

Li et al 2021

explosions in the sky

explosions in the sky

Astronomy’s Discovery Chain

Discovery Engine

10M alerts/night

Community Brokers

target observation managers

the astronomy discovery chain

LSST data will be insufficient for individual transients

Can we study unusual SNe with Rubin data alone?

Data Driven Templates for rare classes of supernovae arising from massive stars: can we tell them apart from sparse LSST data lightcurves?

Creating templates from over 1000 photometry of Stripped Envelope Supernovae

Khakpash, Bianco, et al. in prep

Willow Fox Fortino's next paper

Do we really need a spectrograph??

Umer Zubair's

master's thesis

fast transients with Rubin LSST

Khakpash, Bianco, et al. in prep

Data from Anna Ho et al 2021 - ZTF

Presto Color observing strategy

proposing an LSST strategy collecting 3 images in 1 night in 2 filters Bianco et al. 2019

also:

Andreoni et al.

w FBB  2019

Margutti et al.

 w FBB 2018

Andreoni et al.

w FBB and Xiaolong Li 2021

A probabilistic classifier for unusual transients within a single night of observations

Mr. Ming Lian Master Thesis

Sampling 40,000 transients

for each of 22 classes

in a hypercube in 6 dimensions:

- DT1

- DT2

- Filter 1

- Filter 2

- color

- magnitude

Sampling 40,000 transients

for each of 22 classes

in a hypercube in 6 dimensions:

- DT1

- DT2

- Filter 1

- Filter 2

- color

- magnitude

Punusual~0.95

Punusual~0.01

A probabilistic classifier for unusual transients within a single night of observations

Mr. Ming Lian Master Thesis

Difference Image Analysis

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

Acero-Cuellar et al. DESC submitted

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

difference

-

=

Acero-Cuellar et al. DESC submitted

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

difference

-

=

Acero-Cuellar et al. DESC submitted

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

difference

-

=

Saliency maps: what pixels matter? 

search

template

difference

95% accurate

Acero-Cuellar et al. DESC submitted

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

difference

-

=

95% accurate

Acero-Cuellar et al. DESC submitted

Improving the efficiency of transient detections with Neural Networks: can we avoid template subtraction altogether?

search

template

difference

-

=

95% accurate

Acero-Cuellar et al. DESC submitted

Saliency maps: what pixels matter?

Acero-Cuellar et al. DESC submitted

original paper : Karen Simonyan, Andrea Vedaldi, Andrew Zisserman 2013

Saliency maps: what pixels matter?

Acero-Cuellar et al. DESC submitted

search

template

difference

Saliency maps: what pixels matter?

search

template

difference

template

search

Acero-Cuellar et al. DESC submitted

Saliency maps: what pixels matter?

search

difference

template

search

Acero-Cuellar et al. DESC submitted

Research Inclusion: sonification of LSST lightcurves

Riley Clarke, UD grad student Sid Patel, UD undergrad summer research project

Sonification: Data → Sound

New way of understanding data

• Can be complementary to visualizations

• Gives access to people who cannot
  interpret data visually

• Sounds cool! Good for public outreach

Research Inclusion: sonification of LSST lightcurves

Rubin Rhapsodies

Research Inclusion: sonification of LSST lightcurves

Rubin Rhapsodies

https://lsst-tvssc.github.io/RubinRhapsodies/

Light Echoes

Light Echoes

η-Carinae light echoes

Rest et al. (w Bianco) 2012Natur.482..375R​

Light Echoes

η-Carinae light echoes

Frew 2004, Smith & Frew 2011

Light Echoes

η-Carinae light echoes

Light Echoes

η-Carinae light echoes

Li et al. submitted

AILE: the first AI-based platform for the detection and study of Light Echoes

NSF Award #2108841

Detecting and studying light echoes in the era of Rubin and Artificial Intelligence

P.I. Bianco

Pessimal AI problem:

• small training data
• inaccurate labels
• imbalance classes
• diverse morphology
• low SNR

AILE: the first AI-based platform for the detection and study of Light Echoes

YOLO3 + "attention" mechanism

precision 80% at 70% recall with a training set of 19 light echo examples! 

NSF Award #2108841

Detecting and studying light echoes in the era of Rubin and Artificial Intelligence

P.I. Bianco

Li et al. submitted

Multi-city Urban Observatory Network

Dobler, Bianco, et al 2021, in Remote Sensing

Studying cities as complex systems through imaging data

Multi-city Urban Observatory Network

Dobler, Bianco, et al 2021, in Remote Sensing

Studying cities as complex systems through imaging data

• energy demand and consumption
• ecology of flora and fauna
• urban metabolism
• circadiem rhythms

Multi-city Urban Observatory Network

From Light Echoes to Polluting Plumes

Ian Heffner, UD MSDS

​improved image

subtraction through PCA

Pessimal AI problem:

• small training data
• inaccurate labels
• imbalance classes
• diverse morphology
• low SNR
• complex BG

From Light Echoes to Polluting Plumes

Ian Heffner, UD MSDS

​improved image

subtraction through PCA

Pessimal AI problem:

• small training data
• inaccurate labels
• imbalance classes
• diverse morphology
• low SNR
• complex BG

Plumes and heat in NIR

Plumes in hyperspectral imaging

Text

COVID-19 - an opportunity to be useful or an opportunistic exploitation of a serious problem?

Is there a need?

dont overestimate the resources that are available

"Christiana care is seeking someone with Python expertise..."

surge plans rely on mutual aid between States

Is there a need?

• Delaware is a small state (unlike Washington State, CA, NY)
• 5 hospitals only one has an epidemiological team... of 1
• There are limited computational resources in people and in hardware

"Christiana care is seeking someone with Python expertise..."

Can I fulfill that need?

• Is there a team of domain experts you can work with?

"Christiana care is seeking someone with Python expertise..."

"ChristianaCare is seeking someone with Python expertise..."

to work with the CC Value institute epidemiologist and software engineer

DE COORDINATION

EPIDEMIOLOGY

INTEGRATION W CC NEEDS AND RESOURCES

COVID-19 - through Eric Best we have the most accurate dataset on COVID of all of the USA

Eric Best works tirelessly to harvest and curate data from each DE hospital (and now  potentially PA) and demographic data from DEMA

Dr. Eric Best, UD Biden School, now Ass. Professor at PennState

    . what are the impacts of DE’s unique demographic distribution on hospitalization?

    . how will policy changes affect disease progression and hospitalization?

    . will there be a suppression of disease propagation in future summer months?

    . how do we incorporate behavioral properties of the in- and out-of-state sub-populations?

    . what level of resurgence might we expect to see if social distancing is relaxed (e.g. UD repoen)?

    . if re-infection is a possibility, what is the efficacy of vaccines?

    . new virus variants?

DE Schools closing

murder of

George Floyd

US election campaign

Vaccines

Delta Variant,

pessimistic prediction

MSDS 2020

Jonathan Clifford

Farid Qmar

Engineering &

Public Policy PhD

 NIH The Effects of Subpopulations and Policy Change on COVID19 Hospital Demand Models  P.I Dobler, CoP.I. Bianco

dashboard now being used by other states 

e-DHARMA: a DHARMA emulator

Manjula Ibrahim

MSDS Thesis 2021

 NIH The Effects of Subpopulations and Policy Change on COVID19 Hospital Demand Models  P.I Dobler, CoP.I. Bianco

Replacing MCMC with a Neural Network to speed up the predictions

This framework allows for substantial flexibility to include effects such as:

        · time-dependent social distancing

        · mask mandate compliance

        · person-to-person contact rates

        · age, gender, race, and ethnicity  

        · individual susceptibilities

        · comorbidities

        · probabilistic hospital length of stay

        · asymptomatic subpopulations

        · vaccine availability and use

        · closing and reopening

        · hospital discharge and intake operations

"It has been invaluable to have predictions for the next week instead of having to panic about the next shift"

DE Hospital Director

A UD COVID-19 hackathon 

Health Care and Recovery

Jinny Sawyer-Morris's thesis

in Human Development and Family Science

longitudinal surveys of 120 individuals;

61% women

8 sober living homes

Exploring Gender-Specific Differences in Substance Use Disorder Recovery Capital:

Rubin Observatory LSST 

Rubin Observatory LSST 

Rubin LSST will deliver 10M alerts each night about anything that changed in the southern hemisphere sky: supernovae, merging stars, transiting planets, gravity bendind light and magnifying stars...

to anyone in the world by a set of selected "brokers" that will work with Rubin to accomplish this incredible goal!

the data belongs to the people!

within 60 second of detection!

Rubin Observatory LSST 

The LSST Science Platform

Rubin Observatory LSST 

Rubin and MMA

Rubin Observatory LSST 

LIGO/VIRGO area of localization ~100deg square

 Ursa Minor contains 255.86 square degrees

S190425z 18% of the sky localization

Rubin Observatory LSST 

Rubin can find the electromagnetic counterpart of Gravitational Wave and Neutrino discoveries better than any survey!

LIGO/VIRGO area of localization ~100deg square

 Ursa Minor contains 255.86 square degrees

Rubin FoV 10 deg

S190425z 18% of the sky localization

Rubin Observatory LSST 

 AT 2017gfo

optical counterpart we have identified near NGC 4993 is associated with GW170817

Evidence that mergers of NS are significant sources of r-process elements heavier than iron, including gold and platinum, which was previously attributed exclusively to supernova explosions

Rubin Observatory LSST 

Rubin Observatory LSST 

MARGUTTI+ 2018

Rubin Observatory LSST 

MARGUTTI+ 2018

Rubin Observatory LSST 

Rubin and LEOsats

Rubin Observatory LSST 

MMA and LEOsats

Iridium satellite number 35 lit up the predawn sky west of Boston at 5 a.m. EST on February 1, 1998,  Sky & Telescope

Satellite flares

Time domain Rubin LSST science

can be mitigated:

- orientation of satellite,

- directing flares away from observer

- knowing coordinates to associate them to alerts

if not mitigate there would be bogus alerts and images ruined by saturating flares

Hainaut & Williams 2020

https://arxiv.org/abs/2003.01992

Tyson+ 2020

https://arxiv.org/abs/2006.12417

modification to planned schedule carry long lasting consequences on the program

ToO enabled for GW need to scan ~100 sq deg footprint upon trigger - will be compromised

Time domain : the LSST observing strategy

Static Sky: correlated noise and cross talk

Cosmology probes are systematic dominated

mitigation: simulation of the non-linear crosstalk to measure the effect on precision cosmology and effectiveness of removal algorithms

(image credit: Canada-France Hawaii Telescope)

Tyson et al. 2020

https://arxiv.org/abs/2006.12417

Rubin Observatory LSST 

Diversity Equity Inclusion

Rubin LSST Science Collaborations

We aspire to be an inclusive, equitable, and ultimately just group and we are working with renewed vigor in the wake of the recent event that exposed inequity and racism in our society to turning this aspiration into action.

Rubin LSST Science Collaborations

what's in a name?

The first ground-based national US observatory named after a woman, Dr. Vera C. Rubin 

VRO

In the first 10 years of its life Rubin will conduct the Legacy Survey of Space and Time or LSST