PFHub Progress?

Daniel Wheeler

https://pages.nist.gov/pfhub

What'S new

• 55 merged pull requests
• 18 closed issues
• 306 new commits
• 30 new uploads
• 6 contributors

Pull REQUEST Reviews

What's new

• Nix build for PFHub (Ruby, Python, Node)
  • Completely  deterministic and reproducible build
  • Much simpler Travis CI recipe shared with development environment
  • Travis CI builds are cached
• Difficult to maintain single build environment for multiple  languages

What's new

• License switched from MIT to NIST
• Simplifications to upload process
  • Auto comment on upload pull request
  • Correct to raw URLs when incorrect

Prose.io wiki demo

What'S New?

Prose provides a beautifully simple content authoring environment for CMS-free websites. It's a web-based interface for managing content on GitHub. Use it to create, edit, and delete files, and save your changes directly to GitHub.

PFHub DEsIGN

What NEXT?

• Use MDF and/or Citrine Platform
• Comparison pages for all benchmarks
• Code refactor
  • Vega → Plotly
  • Remove backend data processing
• Annotated upload examples using #491
  • How to archive data and implement benchmarks
  • Lint data on submission
• Implement backend app
  • Authenticate with GitHub on upload
• Improve benchmark comparisons
  • more, bigger data
  • tags
• Upload and run containers

MILESTONES

• v0.1: code metadata, May 2016

• v0.2: upload results with meta.yaml, May 2016

• v0.3: notebooks, benchmark specs, Dec 2016

• v0.3.1: result pages, charts, upload form, Sep 2017
• v0.4: reorg the site, Oct 2017
• v0.4.1: all BM specs, Dec 2017
• v0.4.2: refactor upload form, Feb 2018
• v0.4.3: all results comparison pages
• v0.5: developer uploads, big code refactor, improve frontend UX, make comparison pages better
• v1.0: uploads from wider community, data app/server
• v1.1: improve benchmark comparisons
• v2.0: upload and run simulations

Past

Future

REVIVE CHAT MeetINGS?