federica bianco
astro | data science | data for good
Building a community and its infrastructure
University of Delaware
University of Delaware
with LSST and the SCIENCE COLLABORATIONS for SOFTWARE DEVELOPERS
Project | Etendue [m2 deg2 ] | Total # objects | Alerts/night | Expected final dataset |
---|---|---|---|---|
LSST | 319 | ~37 billion | ~10 million | 512 PB |
ZTF | 8.85 | ~1.8 billion | ~1 million | ~3.2 PB |
Gaia | ~1 billion | 10-20 | >550 GB |
Wide-Fast-Deep
(~85%)
Wide-Fast-Deep
(~85%)
Galactic Plane (1.7%):
North Ecliptic Survey
South Celestial Pole (2.2%):
Deep Drilling Fields
DSS: digitized photographic plates
SDSS
DLS
LSST simulated
LSST will generate a revolutionary dataset, but the responsibility, pleasure, and burden of turning it into science belongs to the “public”, i.e. the scientific community, all of the scientific community in the US, since the LSST data will be public to all US scientists.
Data Products Definition Document
http://ls.st/dpdd
Since January 2016
Since October 2017
a community of users and makers
LSST SCIENCE COLLABORATIONS
2000 scientists, ?? institutes,
8 teams, 5 continents...
nearly all unpaid
The LSST Science Platform
The LSST Science Platform
Light Echoes -- the reflection of stellar explosions on interstellar dust, Light Echoes appear in the sky as faint, extended, variable features ; will be entirely missed. Generative models can address this low signal-to-noise regime computer-vision problem in with a limited training set.
Querying the community is not always easy...
TVS Science Collaboration computing requirements
a case study
Community Brokers
Astronomy’s Discovery Chain
Discovery Engine - LSST
10M alerts/night
a TVS perspective
Astronomy’s Discovery Chain
Community Brokers
Astronomy’s Discovery Chain
TOM (R. Street talk)
Astronomy’s Discovery Chain
AEON
(R. Street talk)
Astronomy’s Discovery Chain
SCIENCE PIPELINE
Community Brokers
serving the community with selected transients to study and follow up
Francisco Förster Buron http://alerce.science/
Saha, Matheson https://antares.noao.edu/
Ken Smith https://lasair.roe.ac.uk/
Community Brokers
serving the community with selected transients to study and follow up
what does the community need?
how to engauge the community?
Community Brokers
serving the community with selected transients to study and follow up
Community Brokers
serving the community with selected transients to study and follow up
Community Brokers
serving the community with selected transients to study and follow up
14 LoIs for community brokers
Since January 2016
Since October 2017
lessons learned
200 members. interacting with ~30
code of conduct
how to write a CoC
our imput is always partial, at time biased, never as good as we want them to be
hackathons and task forces
thank you!
@fedhere
fbianco@udel.edu
01) who is your instrument's community?
02) how many users does your instrument have, and how is this metric tracked?
03) how is communication with the user base conducted, and at what frequency?
04) what efforts are made to expand the user base?
05) what are the bibliometrics for your instrument over time (citations, citations to citations, honors, etc)?
06) how often is an article published/distributed that describes new capabilities?
07) what offshoots or spinoffs from the main software instrument have arisen?
08) who is the developer community?
09) what is the developer model?
10) how are new developers attracted?
11) how are developers retained?
12) what efforts are made to build a diverse developer base?
13) what has been the historical funding profile for your instrument?
14) what current funding efforts are underway or on the near horizon?
15) offer a definition of "sustainability" for your instrument.
16) what efforts have/are being made to reach this definition of sustainability?
17) will your instrument be widely used by your community in 10, 20, 40 years?
By federica bianco