image via user 'photos_ frompasttofuture' unsplash
You can expand your overview by:
If you want to actually get anything out of your overviews, you have to do the work.
- making a note of what you read; what the author's goal was, their methods, their intended audience (not, 'other academics', but e.g.,, 'researchers engaged in an argument over what an 'assemblage' really means and how to identify the _meaningful_ relationships therein)
- drawing connections between what you read and what you heard in the lecture
- drawing connections between what the exercise does and the things you've read and heard, ie, he's giving me this exercise: why? what does the exercise do? where are the moments where my decisions about definitions and questions and so on matter?
- associated with the work of Hillier & Hanson at the Bartlett School of Architecture
- an elaboration of network analysis, but for built space
- architects have found that certain measures hold implications for how a building might affect/promote/change social relationships within the space
- archaeologists say, 'if that's the case for buildings now, then that's likely for buildings in the past; therefore we might argue it is a method that lets us understand built space even in the absence of other archaeological data'
Most of it is proprietary. There are some plugins for QGIS
There is a lot of dead software, which shows there are fashions in digital archaeology same as anything else.
But this paper shows you how to do things by hand, on a small scale
Space = node
Door = edge
Begin by moving from a generic 'outside' node.
n = 6
MD = count the depth from one room to another:
| outside | 1 | 2 | 3 | 4 | 5 | |
|---|---|---|---|---|---|---|
| outside | 0 | 1 | ||||
| 1 | 1 | 0 | ||||
| 2 | 2 | 1 | 0 | |||
| 3 | 2 | 1 | 0 | |||
| 4 | 3 | 2 | 0 | |||
| 5 | 3 | 2 | 0 |
Deblauwe walks you through the math. It is a matter of adding up columns and calculating column and row averages.
Note how one difference makes for a completely different experience of space! That's what these numbers capture.
- this is a way of finding and categorizing similar building or city plans: similarity implies similar ways of living or being
- this is a way of finding similar clusters of similar spaces within buildings or cities
- these are also movement models (see eg Laurence on Pompeii)
- sometimes, a city/building plan is all we've got in terms of archaeological evidence. Space Syntax is a set of theoretical statements that allow us to derive a method that then lets us ground an interpretation using what data we have
- such similarities can then be correlated or compared with other kinds of archaeological evidence
Networks can represent the past
Networks are present in archaeological materials
Networks can be a substrate for further simulation
Networks can problem solve
Dash Khatami via unsplash
Good ol' Wikipedia! https://en.wikipedia.org/wiki/Neural_network https://en.wikipedia.org/wiki/Perceptron. Rosenblatt 1958 figures out how to take the math of Warren McCulloch and Walter Pitts, itself based on the work of 19thc and early 20thc biologists
A complex neural network
(one small slice of mouse)
https://en.wikipedia.org/wiki/Perceptron; Charles Wightman adjusting the machineWorkable ways of (re)training neural networks in a reasonable amount of time, with a reasonable amount of data*
*terms and conditions apply
What happens if we use the ability of networks to represent relationships as the substrate for computation?
One answer: agent based models.
Another answer: neural networks that learn patterns.
(and these patterns involved imagery, at first, but any data can work)
Machine learning - learning of patterns - is enormously useful in archaeology.
There are patterns in data; finding recurrent patterns over time/space is something machines can do
Supervised vs. Unsupervised
Supervised: here are 1000 examples from class 1, here are 1000 examples from class 2, apply this set of rules (ie, an algorithm) to decide which category a new unlabeled example belongs to.
- A really good explainer for one such algorithm https://mlu-explain.github.io/decision-tree/
- classification - dealing with categories (ie: dressel-24)
- regression - dealing with values (ie, no labels: weight) (see https://mlu-explain.github.io/ for a variety of algorithm explainers)
Unsupervised: deploys various algorithms to find clusters of 'similar' data points, but susceptible to noise; messy data (like in archaeology) usually screws everything up.
...and what used to be difficult is now something you can do in a webpage...
- using machine learning to visualize / categorize patterns: very commonplace in archaeology
- but much depends on the quality of your data.
- Vesuvius Challenge represents a moment when many different kinds of machine learning techniques are brought to bear
Some ways we used
convolutional neural networks
in our study on the
human remains trade
Researchers working on machine translation would take parallel texts and try to classify words/sentences/ideas in one language by reference to another (like pictures of cats and the textual label 'cat'). Another approach was to mask out key words and then predict the missing word based on the words around it.
My dog has fleas.
Then they figured out a way to improve the results through some very clever math.
The consequence of that improvement: hey, if we don't tell it to stop, it will actually generate new text that follows along!
...there's a reason these things are called 'language models'.
But some argue they're actually models of culture.
My first excavation involved a vampire...
Text
Colton Sturgeon, UnsplashYou're now going to get 10 weeks of my hist4805 class compressed into a single oracular presentation.
(by the way you can see the class at hist4805.netlify.app)
Łukasz Łada, UnsplashNuggan
Clacks
Where do the shadows come from?
The result of that class:
if they are models of culture, then there can be an archaeology of generative AI perhaps.
Layers of dead data, pattern detection throughout
so, some observations if we look at LLMs from an archaeological perspective....
DH: analyzes an image to say this is a 'red figure kantharos'
GenAI says: here are the conventions that align with the idea of a kantharos rendered as pixel data
Generative AI is digital humanities run in reverse.... AI becomes a system for producing approximations of human media that align with all the data swept together to describe that media.
Salvaggio, Toward a Multi Modal Media Theory
Sam Barber via unsplash
h/t to Steven Johnson for a piece connecting Molaison & Context Length
"The computational cost scales quadratically with the length of the context window, meaning a model with a context length of 4096 tokens requires 64 times more computational resources than a model with a context length of 1024 tokens."
and we're not even talking
here about the cost(s) of siphoning
all the content in the world to get the
necessary data
...the materiality of digital archaeology...
Isi Parente Unsplashfunction ELIZA GENERATOR(user sentence) returns response Let w be the word in sentence that has the highest keyword rank if w exists Let r be the highest ranked rule for w that matches sentence response ← Apply the transform in r to sentence if w = 'my' future ← Apply a transformation from the ‘memory’ rule list to sentence Push future onto the memory queue else (no keyword applies) Either response ← Apply the transform for the NONE keyword to sentence Or response ← Pop the oldest response from the memory queue Return response
- who was Eliza
- what is the Eliza effect? I'll interact with it, then you tell me.
- the human tendency to see intentionality behind text; the Turing test and 'passing'
https://shawngraham.github.io/homecooked-history/sentence-analyzer/
This toy lets you define a direction in semantic space and then visualize sentence fragments along that direction. Uses a language model but *not* a generative one
Give it a try on any AI pronouncement; define a spectrum capturing 'religiosity'. What do you spot?
see Drew Breunig: The 3 AI Use Cases
God - Intern - Cog
No gods, no interns. Only cogs.
(which would mean way less money/power for techbro oligarchs/klept)
necromancy for good instead of evil
but we've already encountered Petrie, right? What might we learn by conversing with his ghostly 'nugannitic' echoes?
Fire up colab, go to file, open, and give it this URL in the github option:
https://github.com/shawngraham/hist3000-f26/blob/main/assets/notebooks/practical-necromancy.ipynb
We'll take what Petrie wrote, and fill in the gaps with an LLM.... just like those scientists at Jurassic Park filled in the gaps in dino dna with amphibian DNA.
And that worked out ok.
Right? ... Right...?
(we're using GPT2, a 'completion' model that can have additional layers of training added to it. By playing with this we dispel some of the Eliza effect)
You'd think this would be difficult to do. Nope.
(and now there's a small industry of academic papers on 'digital necromancy' meaning all this)
An example I've used in other classes. Generate 1000 images from the exact same prompt. (notebook here, 1.2.1)
what 'attractors' for 'archaeological excavation' do we see?
We're using a slight modification to Salvaggio's method for
Ghosts in Text Generation?
(Code is in the previous repo, exercise 1.3)
same principle - different scale
https://www.youtube.com/watch?v=bxXdGBSDCHQ
DIY run-of-stream hydro electricity rig
https://en.wikipedia.org/wiki/File:Hoover_dam_from_air.jpg
- we can study it from an archaeological perspective
- as a kind of pattern matcher, there can be times when it can be deployed for archaeological purposes
- but if pattern matching is what we're after, then we'd be better off using actual:
- uses similar underlying architectures, but is never promoted as having some kind of 'consciousness'
most/a lot of genAI hype is for political purposes towards the goal of decreasing wages; the eugenics is just a 'nice' bonus
https://github.com/shawngraham/personal-image-search-engine
LLM are no good for specific information retrieval; the ghosts push towards the mean, the average, so you get plausible text, not correct text.
This same property does permit searching by 'similarity'