Oct 15, 2019
Agriculture Victoria mtg Oct 2019
Daniel Moore
Applications Engineer, iRODS Consortium
Pilot - iRODS and UAV Data
at Agriculture Victoria
iRODS at Agriculture Victoria
Initial Goals
- Upload existing AVR data as example content into S3 bucket avr-irods-data
- Get S3 files/folders registered to iRODS catalog
- Extract salient metadata - eg EXIF tags in .TIF files
- Tag Data Objects and Collections to make them Actionable and Discoverable
ICAT
(iRODS object database)
iRODS and S3 setup
S3 storage
(avr-irods-data)
references
user
client app
policy
1. iRODS automated ingest registers S3 bucket contents
2. Catalog references bucket objects via
iRODS's S3 cacheless storage plugin
3. Clients interact
with iRODS objects &
stored metadata
federated collaborators
ICAT db
Metalnx
CloudBrowser
iRODS Data/AVU - access and queries
(localhost:8080)
(localhost:9090)
Command Line Query
S3 storage
WebDAV
(localhost:80)
Web Browser
View / Query
Web Browser
View / Modify
iRODS
iRODS - sample query
Query using imeta, a command-line iRODS client utility:
imeta qu -C TYPE = pix4d and \
EXPER like '%wonwondah%' and \
YMD '>=' 2018-09 and \
YMD '<' 2019-01 and \
STRUCT like '%ortho%mosaic%'
iRODS at Agriculture Victoria
Upcoming Goals
- Index images, reflectivity and vegetation index geo-databases to allow quick search
- Enable collaboration/cross-organizational search via federation
- Enable visualization and interaction via the web
Thank you
Questions?