data.nasa.gov Digital Scientific Data

Hosting Overview

jason.duley@nasa.gov

10/3/2016

beth.beck@nasa.gov

Topics

  • ​OSTP Integrated System (Peer Review Publications and Digital Scientific Data)

  • data.nasa.gov

  • Hosting Data

  • Case Study/Example

  • Discussion

OSTP Integrated System

data.nasa.gov

  • data.nasa.gov home page 
    • Data Catalog
    • Developer Portal
    • Data Success Stories
  • Data Catalog 
    • Search by Keywords
    • Filter by Categories/Types
      • Maps
      • Charts
      • APIs
      • Datasets

Hosting Data

  • External Datasets
    • Metadata points to authoritative source
    • Describes dataset w/ common vocabulary
  • Hosted Datasets
    • On Platform/Leverage Data Services
      • Tabular, Spreadsheets, Structured
    • Traditional Web Server Hosting
      • For Exotic Types - Telemetry, Binary, Hierarchical based, etc.

Typical Data

  • A very common format of scientific results is tabular.
  • Consider an Excel File of experimental results
  • Outgassing Experimental Data

Hosting Datasets on data.nasa.gov

Example Scenario: Publish tabular data/results for a publication

Import on data.nasa.gov

Define Data Types

  • This wizard screen allows the data steward to map dataset fields to internal hosted dataset constructs

Data Now Hosted 

  • View results as "Excel" on the web
  • Sort Columns
  • Filter
  • Discuss
  • Visualize
  • Programmatically via API 

Define Metadata

  • Dataset metadata is defined compliant with Project Open Data version 1.1

 

  • Extensible metadata fields can also be added
    • Publication
    • Source Code 

Hosted Data Exposed as API

  • REST-based API can be integrated into apps/services to make use of data
  • API can be used in conjunction with released software

Live Pages & Discussion

Backup

OCIO Open Data Initiative

  • Lead Implementation of M-13-13 for NASA
  • Work with Data Owners across the agency to Federate Dataset metadata
  • Address Quarterly OMB Mandates
  • Maintain Public Data Listing (PDL)
    • Dec 2013 - 25 datasets
    • Today - 32k datasets and growing!
  • Contribute/Collaborate with Federal Government on Schema Vocabularies 
    • Project Open Data effort
  • Related Efforts - API Program / Open Source Software

data.nasa.gov Features

  • Searchable Data Catalog
  • Core/Extensible Data Registry
  • Project Open Data Compliant Core Metadata
  • Available Data Services
    • Visualizations
    • APIs
    • Dataset Hosting
    • Dataset Meta-records
    • Dataset Commenting/Discussions

Dataset Metadata

  • NASA Open Datasets are described by Project Open Data v1.1 Standard Metadata Vocabulary
  • Contains Required & Optional fields:
    • Title, Description, POC
    • Data Dictionaries/Keywords
    • License/URLs
    • References, etc.
  • Is extensible
    • Publications
    • Source Code

https://project-open-data.cio.gov/v1.1/schema/

Made with Slides.com