Trove as a platform for digital research and creativity

PLAY ALONG

http://slides.com/wragge/trove-data-workshop-uc-2019

things you need

Beyond the web interface

New possibilities for:

Integration
Creativity
Analysis

Atlas of Living Australia – automatically retrieves resources relating to species, eg. Magpie
To be continued..., by Kath Bode
The Loom index, DXLab SLNSW

INTEGRATIONS

CREATIVE PROJECTS

Eyes on the past
Drifter, by Mitchell Whitelaw
TextContext, by Riley Post
Culture Collage, by Zenlan

ANALYSIS & visualisation

By Adel Rahmani:

SOME THINGs To Make

(no coding required!)

Make your own game!

https://glitch.com/edit/#!/trove-headline-roulette

DIY TROVE exhibition

https://github.com/wragge/diy-trove-exhibition

Make a Trove Twitter Bot

https://101dhhacks.net/2018/01/21/trove-bots-for-all/

Big pictures

http://dhistory.org/querypic/

Getting data from Trove

Where's the data?

Metadata (collection records)
Search results and facets
Full text
Images

Machine-readable data

{
    "id": "153942274",
    "url": "/work/153942274",
    "troveUrl": "https://trove.nla.gov.au/work/153942274",
    "title": "Clement Wragge, 1899",
    "contributor": [
        "Nicholas, Sir Harold"
    ],
    "issued": 1899,
    "type": [
        "Photograph"
    ],
    "holdingsCount": 1,
    "versionCount": 1,
    "identifier": [
        {
            "type": "url",
            "linktype": "fulltext",
            "value": "http://hdl.handle.net/10462/deriv/134400"
        },
        {
            "type": "url",
            "linktype": "thumbnail",
            "value": "http://bishop.slq.qld.gov.au:80/webclient/DeliveryManager?pid=185373&custom_att_2=simple_viewer"
        }
    ]
}

Machine-readable data

 "facets": {
    "facet": {
        "name": "state",
        "displayname": "Place",
        "term": [
            {
                "count": "36687",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=New+South+Wales",
                "search": "New South Wales",
                "display": "New South Wales"
            },
            {
                "count": "33036",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Queensland",
                "search": "Queensland",
                "display": "Queensland"
            },
            {
                "count": "23058",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Victoria",
                "search": "Victoria",
                "display": "Victoria"
            },
            {
                "count": "22950",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Tasmania",
                "search": "Tasmania",
                "display": "Tasmania"
            },
            {
                "count": "9235",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=South+Australia",
                "search": "South Australia",
                "display": "South Australia"
            },
            {
                "count": "4662",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Western+Australia",
                "search": "Western Australia",
                "display": "Western Australia"
            },
            {
                "count": "235",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=ACT",
                "search": "ACT",
                "display": "ACT"
            },
            {
                "count": "75",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Northern+Territory",
                "search": "Northern Territory",
                "display": "Northern Territory"
            },
            {
                "count": "70",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=National",
                "search": "National",
                "display": "National"
            },
            {
                "count": "15",
                "url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=International",
                "search": "International",
                "display": "International"
            }
        ]
    }
}

Machine-readable data

Sources of data

Pre-packaged datasets
Harvesting tools
The Trove API

PRE-Packaged datasets

Full text of digitised journals – 6.6gb from 358 different journals
Includes The Bulletin, Pacific Islands Monthly, Wireless Weekly, Australian Women's Mirror & many more
Metadata available as CSV files

PRE-Packaged datasets

9,738 text files from digitised books (and ephemera)
And a bonus 1,513 text files from books in the Internet Archive
Metadata available as CSV files

PRE-Packaged datasets

PRE-Packaged datasets

Politicians talking about 'immigrants' and 'refugees' – 12,619 text file harvested from the Parliamentary Library via Trove
ABC Radio National programs
Geolocated newspaper titles
Australian Government Gazettes – 3.4 million articles available from Trove as a bulk download

PRE-Packaged datasets

3,471 editorial cartoons from The Bulletin
At least one cartoon for every issue between 1886 and 1952
Compiled into PDFs for easy browsing
Download high-res images

Tools & Examples

THE TROVE API

Delivers Trove data in a machine-readable form
Supports new tools, new interfaces, new uses
Web site for humans, API for computers!
See Building with Trove

How does it work?

Request a URL, get back data

https://troveconsole.herokuapp.com/

GLAM Workbench

Many examples of downloading and using Trove data
Run code live in your browser using Jupyter notebooks
Copy, change, hack and learn!

https://glam-workbench.github.io/

A possible pathway

Explore Trove newspaper results over time
Harvest newspaper metadata & text for further analysis
Visualise texts using Voyant
Instructions...

QueryPic deconstructed

Explore Trove newspaper results over time
Compare words or phrases
Compare a search across states

Trove harvester

Newspaper results in bulk
Metadata and all article text

VOYANT TOOLs

Explore harvested texts
Many tools and visualisations

A possible pathway

Explore Trove newspaper results over time
Harvest newspaper metadata & text for further analysis
Visualise texts using Voyant
Instructions...

MY Stuff

https://timsherratt.org/

	"facets": {
	"facet": {
	"name": "state",
	"displayname": "Place",
	"term": [
	{
	"count": "36687",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=New+South+Wales",
	"search": "New South Wales",
	"display": "New South Wales"
	},
	{
	"count": "33036",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Queensland",
	"search": "Queensland",
	"display": "Queensland"
	},
	{
	"count": "23058",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Victoria",
	"search": "Victoria",
	"display": "Victoria"
	},
	{
	"count": "22950",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Tasmania",
	"search": "Tasmania",
	"display": "Tasmania"
	},
	{
	"count": "9235",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=South+Australia",
	"search": "South Australia",
	"display": "South Australia"
	},
	{
	"count": "4662",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Western+Australia",
	"search": "Western Australia",
	"display": "Western Australia"
	},
	{
	"count": "235",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=ACT",
	"search": "ACT",
	"display": "ACT"
	},
	{
	"count": "75",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=Northern+Territory",
	"search": "Northern Territory",
	"display": "Northern Territory"
	},
	{
	"count": "70",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=National",
	"search": "National",
	"display": "National"
	},
	{
	"count": "15",
	"url": "/result?q=wragge&encoding=json&facet=state&n=0&zone=newspaper&l-state=International",
	"search": "International",
	"display": "International"
	}
	]
	}
	}