Exploring GLAM data in the Humanities

Tim Sherratt ・@wragge@hcommons.social ・timsherratt.org

What can you do with 200 million newspaper articles?

These slides

https://slides.com/wragge/tdwg-2023

1994–1997

Seeing differently

WWI service records

https://recordsearch.naa.gov.au/scripts/AutoSearch.asp?Number=B2455

WEST Ernest Robert : Service Number - 5091 : Place of Birth - Benambra VIC : Place of Enlistment - Sale VIC : Next of Kin - (Mother) WEST Mrs F M

Name: WEST Ernest Robert
Service Number: 5091
Place of Birth: Benambra VIC
Place of Enlistment: Sale VIC
Next of Kin: (Mother) WEST Mrs F M

structured data!

Kevin

me

https://github.com/wragge/recordsearch_data_scraper

NAA: ST84/1, 1913/119/41-50

http://iabrowse.herokuapp.com/series/ST84-1/browse/

https://www.realfaceofwhiteaustralia.net/faces/

See: Sherratt & Bagnall, 'The people inside' in Seeing the Past with Computers

The REAL FACE OF WHITE AUSTRALIA

ASKINg NEW Questions

OCRd text

image

metadata

2011

2023

https://glam-workbench.net/trove-newspapers/

2011

2023

https://glam-workbench.net/trove-harvester/

https://updates.timsherratt.org/2023/08/08/exploring-the-front.html

2012

2023

Understanding Access

1915

2011

2014

2014

2021

https://wragge.github.io/trove-newspaper-totals/

Last Sunday

http://closedaccess.herokuapp.com/

https://insidestory.org.au/withheld-pending-advice/

https://twitter.com/wragge/status/1344805120261832705

https://updates.timsherratt.org/2021/04/21/secrets-and-lives.html

#redactionart

https://github.com/wragge/diy-redactionart

Creating pathways

GLAM data is...

  • collection metadata
  • text
  • images, sound, & video
  • 3d models
  • user generated
  • born digital
  • extracted & enriched
  • & more...

https://glam-workbench.net/wikidata/

Australian government agencies over time

GLAM data

ReseArchers

GLAM WORKBENCH

https://glam-workbench.net/

  • tools
  • tutorials
  • examples
  • handy hacks
  • pre-harvested datasets
  • a work in progress...

The GLAM Workbench is...

  • Trove
  • DigitalNZ
  • Commonwealth Hansard
  • National Archives of Australia
  • National Museum of Australia
  • Te Papa
  • Open data portals
  • Web Archives
  • & more!

COLLECTIONS

https://glam-workbench.net/trove-lists/

Trove user tags

Web archives

https://glam-workbench.github.io/web-archives/

gov.au subdomains

abc.net.au

National Archives of Australia

#redactionart

White Australia policy

https://glam-workbench.net/recordsearch/

DigitalNZ

open collections

Papers Past

https://glam-workbench.net/digitalnz/

Commonwealth Hansard

https://glam-workbench.net/hansard/

GLAM datasets

9.6 million names

https://glam-workbench.net/glam-data-portals/

Assembling data

Asking questions

Hacking heritage

Live documentation

  • 100+ Jupyter notebooks
  • Live code, text, images
  • Same code, different views
  • All in your browser!

The HOW

&

THE WHY

code

chart

text

Jupyter notebook

Getting started

Try it!

https://glam-workbench.net/getting-started/

https://glam-workbench.net/nma/

National Museum of Australia

Explore APIs

  • Trove
  • DigitalNZ
  • National Museum of Australia
  • Te Papa
  • Museums Victoria
  • Web Archives

https://glam-workbench.net/museumsvictoria/

https://glam-workbench.net/more-glam-notebooks/

https://glamlabs.io/

GLAM JUPYTER

PLACES TO START

&

PLACES TO GO

GLAM CSV Explorer

Try it!

https://glam-workbench.net/csv-explorer/

app

notebook

https://glam-workbench.net/trove-newspapers/

ZooM out

&

Zoom in

TROVE newspaper harvester

https://glam-workbench.net/trove-harvester/

HarvestING DATA

READY-TO-GO Data!

https://glam-workbench.net/trove-maps/

PLATFORMS

&

ENVIRONMENTS

Jump in with Binder

one click to start

https://glam-workbench.net/using-binder/

https://glam-workbench.net/using-ardc-binder/

Reclaim Cloud

https://glam-workbench.net/using-reclaim-cloud/

NECTAR Cloud

https://glam-workbench.net/using-nectar/

Docker IMAGES

https://glam-workbench.net/using-docker/

A work in progress

DIY GLAM Workbench

https://glam-workbench.net/get-involved/developing-repositories/

a new GLAM Workbench repository!

https://github.com/GLAM-Workbench/glam-workbench-template

BEST PRACTICES

https://doi.org/10.1002/asi.24835

https://glam-workbench.net/get-involved/

get involved!

https://wragge.github.io/trove-data-guide/

https://ardc.edu.au/project/ardc-community-data-lab/

DATA LABS & Guides

The GLAM Workbench is...

  • Free!
  • Openly licensed to encourage reuse & modification
  • Shared through GitHub
  • Preserved in Zenodo

https://glam-workbench.net/trove-newspapers/

https://github.com/sponsors/wragge

Thank you!

Tim Sherratt

@wragge@hcommons.social

https://glam-workbench.net/

Exploring GLAM data in the humanities

By Tim Sherratt

Exploring GLAM data in the humanities

TDWG, October 2023

  • 846

More from Tim Sherratt