Oct 15, 2019

Agriculture Victoria mtg Oct  2019

 

Daniel Moore

Applications Engineer, iRODS Consortium

Pilot - iRODS  and UAV Data

at Agriculture Victoria

iRODS at Agriculture Victoria

Initial Goals

  1. Upload existing AVR data as example content into S3 bucket avr-irods-data
  2. Get S3 files/folders registered to iRODS catalog
  3. Extract salient metadata - eg EXIF tags in .TIF files
  4. Tag Data Objects and Collections to make them Actionable and Discoverable

ICAT

(iRODS object database)

iRODS and S3 setup

S3 storage

(avr-irods-data)

references

user

client app

policy

1. iRODS automated ingest registers S3 bucket contents

2. Catalog references bucket objects via

iRODS's S3 cacheless storage plugin

3. Clients interact

with iRODS objects &

stored metadata

federated collaborators

ICAT db

Metalnx

CloudBrowser

iRODS Data/AVU - access and queries

(localhost:8080)

(localhost:9090)

Command Line Query

S3 storage

WebDAV

(localhost:80)

Web Browser

View / Query

Web Browser

View / Modify

iRODS

iRODS - sample query

Query using imeta, a command-line iRODS client utility:

 

imeta qu -C TYPE = pix4d and \

   EXPER like '%wonwondah%' and \

   YMD '>='  2018-09 and \

   YMD '<'  2019-01 and \

   STRUCT like '%ortho%mosaic%'

iRODS at Agriculture Victoria

Upcoming Goals

  1. Index images, reflectivity and vegetation index geo-databases to allow quick search
  2. Enable collaboration/cross-organizational search via federation
  3. Enable visualization and interaction via the web

Thank you

Questions?

UAV Data Processing on iRODS at AgVic

By Daniel Moore

UAV Data Processing on iRODS at AgVic

  • 1,000