Monitoring and Troubleshooting Grids
September 8-9, 2016
Centers for Disease Control and Prevention
Atlanta, GA
Terrell Russell, Ph.D.
@terrellrussell
Acting Chief Technologist, iRODS Consortium
The Zone vs. The Grid
Zone Introspection - izonereport
Configuration management for iRODS -
An iCommand which executes a new API call across all servers within a Zone
A Zone Report
Creates validated JSON document which includes:
Schemas can be found at https://schemas.irods.org
Using izonereport
Run only as a 'rodsadmin' user with output to stdout:
izonereport > report.txt
Investigate with 'less' or your favorite editor
Note: Review JSON configuration
The iRODS Control Plane
A control channel which speaks directly to the iRODS Server -- allows for grid-wide operations
Accessed via a separate client command: irods-grid
Check out the March 2015 iRODS Development Update:
The irods-grid command
irods-grid --help
usage: 'irods-grid action [option] target'
action: ( required ) status, pause, resume, shutdown
option: --force-after=seconds or --wait-forever
target: ( required ) --all, or --hosts=", , ..."
irods-grid status
irods-grid status --all
Returns a status of the server (or servers) requested in a validated json document which includes:
irods-grid pause and resume
irods-grid pause --all
Pause - suspend all incoming connections while allowing existing connections to complete
Resume - allow incoming connections from new clients
irods-grid resume --all
irods-grid shutdown
irods-grid shutdown --all Option --force-after=seconds - kill any existing connections after N seconds Option --wait-forever - do not kill existing connections, allowing them to finish irods-grid shutdown --force-after=5 --all irods-grid shutdown --wait-forever --all
Gracefully shutdown an iRODS server or servers allowing existing client connections to complete
Questions?
Please Note: