Updates and data.NASA

 

Big (Data + Think)³

Dalia Kirschbaum  dalia.b.kirschbaum@nasa.gov

Jason Duley jason.duley@nasa.gov

10/22/2015

Topics

• Updates​

• Open Data Portal

• Data Success Story - Landslide.data

• Quick Peek

• Questions

Code Sharing Update

• Internal Software Collaboration Prototypes

  • Developers need options

    • developer.nasa.gov

      • GitHub Enterprise

      • ​100 users

    • Prototype with JSC/Core Flight Software

      • ​GitLab Community / Open Source

      • ​TBD - Failover, CI integration

• Federated Software Catalog - Federating existing heterogenous software versioning systems to enable Search, Distributed Browsing

  • Integrate with Tech Transfer automated processes

  • Provide model-based software descriptions to enable faceted search 

  • Leverage Keyword Tagging APIs for additional automation of project meta-data

API Program Update

• New APIs added

  • Mars Photos:  http://go.nasa.gov/1GfW1Ie

  • Near Earth Objects: http://go.nasa.gov/1KlYFXJ

• APIs in the works

  • Keyword Tagging

  • Acronym Service

  • Techport

• People Like them (3-month analytics)

  • APOD - ½ million hits

  • Earth - 30k

  • Mars Photos - 13k (only live ~ 10 days)

Open Data

• Continuing to federate with data silos across the agency
• Current activities
  • GeneLab
  • DASHLink
  • PDS
• Dept. of Education Collaboration
  • LRMI/DCMI discussions
  • http://go.nasa.gov/1Rqb8Ps

Open Data Portal

data.nasa.gov

• Data portal which delivers structured data via common interface

• Self-service exploration tools for data access and visualization, as well as interactive visual explorers

• Robust APIs, including auto-created API-docs for easy data access.

• Analytics to track usage of your data around the web

• Examples:

  • Dataset:  http://go.nasa.gov/1GnDfyl

  • API: http://go.nasa.gov/1MB7MFQ

Landslide.data

• Prototype: landslide.data.nasa.gov

• Motivation: Provide Missions/Programs/Projects  with Data Platform Tools 

• Implemented around hosted dataset and API services on data.nasa.gov

• Demonstrates re-usable web deployment pattern for a crowd-sourced data-driven site

  • Submission > Data Staging > Approval > Publication

• Built in hours, drastically reduced cost of standing up new website

Landslide Users

• US Agency/Situational Awareness - Analyst identifies past landslides within a region with an evolving event (e.g. El Nino) to get a sense of previous events (and impacts) in the area of interest

• Researcher - User looking for landslide data to use in their research with access the desired data as quickly as possible without having to learn complex tools and frameworks. 

• Citizen Scientist Enthusiast - User interested in Citizen Science projects and wants to contribute their own data or help to advance the structure. They also will hopefully be interested in landslides and could potentially become an "expert" user to help validate events.

• Operational End User

  • Wants access data via API with clear instructions/link to access API to get data (subset by region or for total area)

  • Wants a link to metadata describing what they are obtaining

  • Enable a group of emergency responders, etc. to use this tool while responding to an event

Citizen Science

• Framework for Landslide Reporting
• NASA GSFC developed first publicly available global dataset of rainfall-triggered landslides
• Provides new insight into the frequency, location and impact of these hazards worldwide
• Database of >7,000 entries (2007-2015)
• Game changing for ...
  • Landslide Research
  • Societal Benefit
  • Disaster Response

Landslide Features

• Visualizations of event locations

• Drill-down into regions

• Collect user provided event information

• Crowd-sourced data collection

• Approval workflow for new events

• TBD:

  • Heat Maps and other visualizations

  • Mobile Web Application

Quick Look at

Landslide Prototype