Web Technologies in Medicine: Workflow Managers, Collecting Data, Visualizing, Processing

 

 

Rudolph Pienaar, PhD

 

 

Technical Director
Fetal-Neonatal Neuroimaging and Developmental Science Center


Staff Scientist
Boston Children's Hospital
 


overview of talk

traditional slides...

live interaction - web viewers

live interaction - web management


use the web, Luke...

Web applications are increasingly more powerful, easy to use, and accessible

  • more familiar interface metaphor
    • web 2.0 "social" interaction
    • posting/sharing
  • moves the burden of maintenance away from end user
  • allows for mobile

use the web, Luke...


overview of talk

  • Some viewers that you can use. Right now
     
  • A workflow manager that you can use. Right now, too.

Web-based medical image (esp. radiological image) interaction...


web apps..?

  • Simple, single-purpose
    • Show static information: text and/or images
    • Provide single-focus dynamic data
  • Complex, integrative, but still generically single-purpose
    • Facebook
    • Twitter
    • Mobile: instagram, snapchat, whatsapp, etc...
Web-apps....​
... can be

web apps..?

Web apps...

are

  • Accessible from anywhere!
    • Desktops, Laptops
    • (Smart) Phones
    • Tablets
  • Are "simple"
    • require little end user maintenance
    • just go to a link
  • but...
    • Are typically not as "powerful" as traditional client apps.

Medical Image Viewers

How to view images...

... easily?

  • Cornerstone (Chris Chafey)
  • SliceDrop
  • MedView

Medical Image Viewers


Medical Image Viewers


Medical Image Viewers


what is ChRIS?



ChRIS is a bio-medical data workflow manage that allows easy and intuitive collection, analysis, and sharing of data between parties.


what is ChRIS?

ChRIS also...

  • allows for advanced view rendering
  • allows for sharing of images
  • allows for immersive real time collaboration
  • allows for post-processing of images

components

  • collect
  • manage
  • analyze
  • view
  • collaborate

real time demo...


  • ChRIS instance

collect image data

  • seamlessly connect to standard PACS with Query/Retrieve
  • direct access to server filesystem
  • drag-n-drop from local client into server
  • ssh/scp underpinning for secure network transfers

collect image data


manage image data


  • all "data" is stored in a time-based feed
  • feeds are basically file-browsers
  • feeds can be annotated with free form notes
  • shared feeds can support comments between parties

analyze image data


  • a "plugin" mechanism offers the ability to accept feed data and process data
  • ChRIS is usually configured to communicate transparently with an HPC
  • plugins are mostly non-interactive analysis pipelines
  • interactivity is available as a pre-processing step

analyze image data



view image data


  • image data in feed can be viewed directly in simple drop down window
  • image data can be viewed in more sophisticated fashion with specialized viewing modes
  • advanced sharing using 3rd party backends (Google Real Time API / Dropbox API)

real time collaboration


  • image data can be shared between collaborators
  • Google RealTime API
  • a realtime JSON object is shared and updates each viewer independently
  • (akin to multi-player games)
  • shared screen components (like cursor)

real time collaboration



further references... 


  • https://github.com/FNNDSC/chrisreloaded
  • https://github.com/FNNDSC/ChRIS_API
  • https://github.com/FNNDSC/viewerjs
  • https://github.com/FNNDSC/mi2b2
  • https://github.com/FNNDSC/vjs
  • https://github.com/slicedrop
  • https://goxtk.com

Development team


  • Jorge "To Be" Bernal, PhD
  • Nicolas "VJ" Rannou, MSc
  • Rudolph "Cat Herder" Pienaar, PhD
  • Daniel "X Slicer" Haehn, PhD
  • Daniel "Game On" Ginsburg, MSc
  • Ellen "Doc" Grant, MD

thank you...