data.nasa.gov Digital Scientific Data

Hosting Overview

jason.duley@nasa.gov

10/3/2016

beth.beck@nasa.gov

Topics

• ​OSTP Integrated System (Peer Review Publications and Digital Scientific Data)

• data.nasa.gov

• Hosting Data

• Case Study/Example

• Discussion

OSTP Integrated System

data.nasa.gov

• data.nasa.gov home page 
  • Data Catalog
  • Developer Portal
  • Data Success Stories

• Data Catalog 
  • Search by Keywords
  • Filter by Categories/Types
    • Maps
    • Charts
    • APIs
    • Datasets

Hosting Data

• External Datasets
  • Metadata points to authoritative source
  • Describes dataset w/ common vocabulary
• Hosted Datasets
  • On Platform/Leverage Data Services
    • Tabular, Spreadsheets, Structured
  • Traditional Web Server Hosting
    • For Exotic Types - Telemetry, Binary, Hierarchical based, etc.

Typical Data

• A very common format of scientific results is tabular.
• Consider an Excel File of experimental results
• Outgassing Experimental Data

Hosting Datasets on data.nasa.gov

Example Scenario: Publish tabular data/results for a publication

Import on data.nasa.gov

Define Data Types

• This wizard screen allows the data steward to map dataset fields to internal hosted dataset constructs

Data Now Hosted 

• View results as "Excel" on the web
• Sort Columns
• Filter
• Discuss
• Visualize
• Programmatically via API 

Define Metadata

• Dataset metadata is defined compliant with Project Open Data version 1.1

• Extensible metadata fields can also be added
  • Publication
  • Source Code 

Hosted Data Exposed as API

• REST-based API can be integrated into apps/services to make use of data
• API can be used in conjunction with released software

Live Pages & Discussion

Backup

OCIO Open Data Initiative

• Lead Implementation of M-13-13 for NASA
• Work with Data Owners across the agency to Federate Dataset metadata
• Address Quarterly OMB Mandates
• Maintain Public Data Listing (PDL)
  • Dec 2013 - 25 datasets
  • Today - 32k datasets and growing!
• Contribute/Collaborate with Federal Government on Schema Vocabularies 
  • Project Open Data effort
• Related Efforts - API Program / Open Source Software

data.nasa.gov Features

• Searchable Data Catalog
• Core/Extensible Data Registry
• Project Open Data Compliant Core Metadata
• Available Data Services
  • Visualizations
  • APIs
  • Dataset Hosting
  • Dataset Meta-records
  • Dataset Commenting/Discussions

Dataset Metadata

• NASA Open Datasets are described by Project Open Data v1.1 Standard Metadata Vocabulary
• Contains Required & Optional fields:
  • Title, Description, POC
  • Data Dictionaries/Keywords
  • License/URLs
  • References, etc.
• Is extensible
  • Publications
  • Source Code

https://project-open-data.cio.gov/v1.1/schema/