iRODS S3 Plugin
with Direct Streaming
June 9-12, 2020
iRODS User Group Meeting 2020
Virtual Event
Justin James
Applications Engineer
iRODS Consortium
iRODS S3 Plugin
with Direct Streaming
Existing Cacheless Limitations
The Streaming S3 Plugin (Summary)
The Streaming S3 Plugin (Summary)
The Streaming S3 Plugin (Parallel Put)
The Streaming S3 Plugin (Parallel Put)
Parallel Put (Circular Buffer)
The Streaming S3 Plugin (Parallel Get)
The Streaming S3 Plugin (Parallel Get)
The Streaming S3 Plugin (Using a Cache File)
The Streaming S3 Plugin (Cache - First Open)
The Streaming S3 Plugin (Cache - Read/Write)
The Streaming S3 Plugin (Cache - Last Close)
Implementation Details (Performance)
Implementation Details (Download Peformance)
Implementation Details (Upload Peformance)
Next Steps
Development is almost complete but the final implementation details are being added.
Questions?