iRODS: the product, the vision and the governance model

Friday June 16, 2017

Utrecht University

Utrecht, Netherlands

Jason Coposky

@jason_coposky

Executive Director, iRODS Consortium

iRODS: the product, the vision and the governance model

What is iRODS

A flexible framework for the abstraction of infrastructure

 

iRODS is

  • Open source
  • Distributed
  • Metadata Driven
  • Data Centric

iRODS as the Integration Layer

Data Virtualization

Combine various distributed storage technologies into a Unified Namespace

  • Existing file systems
  • Cloud storage
  • On premises object storage
  • Archival storage systems

iRODS provides a logical view into the complex physical representation of your data, distributed geographically, and at scale.

Data Discovery

Attach metadata to any first class entity within the iRODS Zone

  • Data Objects
  • Users
  • Storage Resources
  • The Namespace

iRODS provides automated and user-provided metadata which makes your data and infrastructure more discoverable, operational and valuable.

Workflow Automation

Integrated scripting language which is triggered by any operation within the framework

  • Authentication
  • Storage Access
  • Database Interaction
  • Network Activity
  • Extensible RPC API 

The iRODS rule engine provides the ability to capture real world policy as computer actionable rules which may allow, deny, or add context to operations within the system.

Secure Collaboration

iRODS allows for collaboration across administrative boundaries after deployment

  • No need for common infrastructure
  • No need for shared funding
  • Affords temporary collaborations

iRODS provides the ability to federate namespaces across organizations without pre-coordinated funding or effort.

From Prototype to Production

Data to Compute Use Case

Compute to Data Use Case

Provenance and Reporting

Institutional repositories

As data matures and reaches a broader community, data management policy must also evolve to meet these additional requirements.

Vision

iRODS

The Roadmap

  • iRODS 4.3
  • Multipart Transfer
    • Cacheless Object Storage
  • Query Arrow
  • Metadata Templates
  • Filesystem Integration

The Roadmap - iRODS 4.3

  • Hardening Release
  • Bugfixes
  • Expanding testing scope

Multipart Transfer

Provide reliable transfer with restart - object parts tracked in the catalog

Later versions will provide fast, first class access to object storage

iRODS 4.2 and Beyond - The Scatter

Next Generation Query Interface

iRODS 4.3 and Beyond - The Gather

Shared Data - Shared Infrastructure

Governance Model

iRODS

The iRODS Consortium

Our Mission

  • Write Good Software
  • Grow the Community
  • Show Value to our Membership

Why Open Source

  • Transparency
  • Quality
  • Persistence
  • Vendor Neutrality
  • Customization
  • Community
  • Try before you buy

Our Membership

Our Business Model

Consortium Membership

  • Participate in roadmap development
  • Participate in consortium governance
  • Direct support from the team
  • Tier 3 support agreements
  • Discount for support agreements

Our Buisness Model

Service & Support Contracts

  • Billed hourly
  • Implement Proofs of Concept
  • Custom rule and plugin development
  • Expand to new use cases
  • Discounted rate for consortium members

Membership Committees

Technology Working Group

  • Monthly web conferences
  • Build iRODS Roadmap
  • Propose new technology direction
  • Propose inclusion of new software
  • Propose new working groups

Membership Committees

Planning Committee

  • Monthly web conferences
  • Discuss consortium policy and business practices
  • Propose conferences and workshops
  • Vote on inclusion of new software
  • Vote on roadmap

Membership Committees

Executive Board

  • Meets twice yearly
  • Votes on consortium budget and bylaw changes
  • Determines the thematic priorities of the consortium

 

Additional working groups are formed as required

Our Consortium Participation

Made with Slides.com