ANU Archives

Sydney Stock Exchange

Tim Sherratt ・@wragge

These slides

https://slides.com/wragge/stock-exchange-project-feb22

• Create a dataset that supports computational analysis
• Extract content of pages while preserving the structure

Aims

Challenges

• Scale – 199 volumes, 70,000 100mb TIFF files
• Structure – rows & columns, print & handwriting
• Variability – changes in column numbers, handwriting, ink, paper

The same,

but different...

Two sets of data

• page metadata (images, volumes, dates, sessions)
• page content (print, handwriting, grid)

To make structured data

• Compile metadata
• Extract text (print & handwritten)
• Reassemble table grid

Finding columns

page width

column widths

gutter

Column widths

Problems?

Dates & sessions

session

date

Checking dates

NSW holidays
1901-1950

https://glam-workbench.net/anu-archives/

Pages, sessions, & dates

https://glam-workbench.net/anu-archives/

Pages per day

https://glam-workbench.net/anu-archives/

Extracting content & structure

Try Textract

Line

Word

Extracting

structures

Rows & columns

Visualising activity

https://glam-workbench.net/anu-archives/

Datasette on GCloud

But beware!

• interface under development
• many problems with the data
• things will change!

Next steps...

https://glam-workbench.net/anu-archives/

https://github.com/wragge/sydney-stock-exchange

More...