Shawn Graham
Catch me on Scholar Social https://scholar.social/@electricarchaeo
@electricarchaeo@scholar.social
You're not talking to an 'AI'. You're talking to Nuggan.
Ridcully and Ponder Stibbons are discussing Hex, the University's thinking engine
'Amazin',' he said again. 'He just looks as though he's thinking, right?'
'Er ... yes.'
'But he's not actually thinking?'
'Er ... no.'
'So ... he just gives the impression of thinking but really it's just a show?'
'Er .... yes.'
'Just like everyone else, then, really, ' said Ridcully.
...humans will do that just fine.
David Corney, A small language model made from matchboxes
But these ghosts are useful.
photo: Salvaggio
see latest here
Mohandas & Moritz, Building a RAG-based LLM for Production
What about, y'know, creative writing, that sort of thing?
Make a new environment
Assuming you have python on your machine, make a new environment.
$ pip install conda
$ conda create -n "experiment" python=3.10
Install LLM
$ pip install llm
Install some plugins
$llm install llm-gpt4all
$llm install llm-clip
If you have an open ai key, you can use those models:
$llm keys set openai
Play
Download and run a prompt against the Orca Mini 7B model
$llm -m orca-mini-3b-gguf2-q4_0 'What is the capital of France?'
Turn your photos into embeddings:
$llm embed-multi photos -m clip --binary --files photos/ '*.jpg'
Search the photos:
$llm similar photos -c 'bunny'
By Shawn Graham
A jaunt through how I'm thinking about LLMs and some of the ways I've been using LLMs
Catch me on Scholar Social https://scholar.social/@electricarchaeo