Libraries in the Age of Extended Reality

Libraries in the Age of Extended Reality

Virtual Reality (VR)

Augmented Reality (AR)
Mixed Reality (MR)

Ken
Fujiuchi

Emerging Technology Librarian

Joseph W. Riggie

Information Systems Librarian

Presenters

Goals

• review AV / VR / MR
• Examine roles for libraries and librarians
• Describe a local AR / VR project
• Explore examples of AR / VR in libraries

LEARN from you

Virtual

• computer generated
• controlled
• immersive

Augmented

• live, physical view
• overlaid sensory information
• approachable

Heads Up Display (HUD)

Games

360 Environment

Mixed Reality

"VR is great at giving you a sense of scale relative to yourself . . . AR is great at giving you a sense of scale relative to your environment

. . . An app built for both VR or AR could let you stand next to the object in VR, at the correct scale  . . . The AR side of it could then project that same object into your room to indicate it if will fit the space . . .

The really exciting point will be when you can do both with a single headset, getting that personal sense of scale and grounding in your environment simultaneously."

Brandon Jones, Chrome WebVR developer

Role of Libraries
and Librarians

Content Curation

• 3D scanning and 360 capture
• Quality and authority control
• Digital curation is necessary

Cataloging

• Cataloging for linked data environment
• Data can be independent of object
• New ways to catalog and record metadata

User Experiences

• New user interface possibilities
• New ways to interact with materials
• New ways to access information

Digital Preservation

• Preserve interactions
• 3D reproduction
• Preservation  through  data

Western New York Library Resource Council (WNYLRC) Initiatives

What is WNYLRC?

• The Western New York Library Resources Council (WNYLRC) is a not-for-profit consortium of libraries and library systems serving six counties in western New York
• Member council in the Empire State Library Network
  • support interlibrary sharing of resources – print and electronic – among all kinds of libraries and to ensure equal access to information for all New Yorkers.

360 Recording Kit

Goals

• Share regional unique experience and environments (portal)
• Capture immersive educational experiences
• Openly license content - CC-BY-NC (OER)
• Develop cataloging for VR/AR content
• Explore legal issues related to VR/AR content

Progress

• Legal and privacy concerns exploration
  • What releases should we provide?
  • How should content be licensed?
  • Who should own copyright?
  • Why branding should be implemented
• Initial testing
  • Compatibility with Android and iOS
  • File sizes and transferability

Planned Projects

• Non-public spaces
  • Metcalfe Room
• Look inside public library branches
• Virtual visits of historical sites
• Theater experiences
• Open educational resources

More progress

• Metadata - how should these objects be cataloged?
• Preservation - what file formats are appropriate for long term preservation?
  • https://www.archives.gov/records-mgmt/initiatives/dav-faq.html
• Access - what platform(s) can be used to store and present this content?

Platforms?

• Storage
  • Islandora
  • Fedora
• Viewing (plugins)

  • jQuery threesixty

  • marzipano

  • Three.js

Next Steps

• Continue testing
  • mounts and tripods
  • test captures and transfers
• Gather use cases
• Improve the housing
  • the kit needs to be portable but have better protection

Examples

Content Evaluation

• What content is deserving of digital preservation?
• What is real?
  Can librarians act as arbiters of genuine content?

Synthesizing Obama: Learning
Lip Sync from Audio

Mythical Maze

http://www.sol.us/mythical/

ShelvAR

• Use AR and visual identifiers to find misplaced books
• Discontinued due to patent dispute

Variation on a theme

Sensor based

Measurement based

Aurasma

• AKA ... HP reveal
• Use trigger images.
• Include rich resources, 3dmodels, video, images

Old City of Dubrovnik

• Recreate spaces with existing datasets
  • Public Flickr images

Flexible Virtual Spaces

Apple ARkit and

 Google  ARcore

• AR Experiments
• Arts and Culture Experiment
• Made with ARkit

LIDAR