Remind to not click ahead.
Annotator is not present at this meeting.
(Annotator pretends to not hear anything.)
Client starts a timer for 3 minutes
Annotator looks at the data on their laptop.
Remind them to make a copy of the sheet!
They annotate for 10 mins while the client pretends they are not there (in reality, they observe silently out of character)
Remind the annotator here to start their 6 min timer - their exams are coming up! Start it yourself as well.
You ask them their exam question "What is Foucault's view on the discourse of the riddle of the sphinx?".
Annotator rolls the dice.
Odd - start the 1 minute timer. Stop annotating for 1 mins and google the answer.
Even - Say to the client that the annotator decided to study for their exams alongside this project. Ask them to keep annotating.
Client says time is up.
NLP engineer asks for change of scope.
Client rolls the dice. Odd - no change. Even - agree to change.
You should also time 5 mins here.
Client says time is up again.
Asks to see the annotations
NLP engineer shows the annotation Google Sheet.
Maybe Client asks some questions about them.
Go to next slide
NLP engineer rolls the dice. Odd - deep learning. Even - truth, just data prep.
Client rolls the dice. Odd - pissed off that not AI. Even - appreciates honest communication.
THE END of Exercise 1.
Go to next slide.
First stick to the questions, will have time for freeform feedback in the end
Then discuss in your small group
10 mins
"Is there anything that was interesting in your group that you think this room will benefit learning from?
5 mins
Clockwise:
Annotator
Client
NLP engineer
about 30 minutes total
Now we have the business owner. Exciting!
They will probably ignore the annotator.
The annotator reminds them that they are in the room and Client should talk to them too.
If after 1 minute they don't , poke the annotator to say it.
Make them focus on missing fields: number of employees and name of owner.
Make them focus on missing fields: number of employees and name of owner.
Stop them from talking about cafe/bakery/discussion now. They will have time for it later
Client agree to dropping number of employees but keeps the owner name.
Make sure they don't rush through it, but do it one rule at a time.
NLP engineer has to present it, client has to carefully consider then accept of course.
Annotator destroys each one of them.
The process has to be difficult for the NLP engineer.
This time we just do Information Extraction for business owner name, business name and postcode
You, the GM, start a 5 minute timer here.
If your group struggles even with your help to understand the Annotation UI then ask Agata, Bhargav, Laurence or Lev for help.
The model suggests candidates for Postcode, Business Name, Business Owner
The slides are exactly the same as you saw on the big screen in the break. This is just repetition to make the participants "own it".
They might struggle as this is the most technical part of the workshop. Help them!
It is expected that the participants don't understand the UI at all at first.
"Where does the text come from?"
It comes from the URL shown at the bottom right corner of the snippet.
"Why is it a small chunk?"
It is to make you focus and not miss anything
1. Make sure all the labels for Postcode, Business Name, Business Owner are correct. Click on the X to remove the label. Add the label by highlighting words.
2. Click the green button to save.
3. If you made a mistake, click Backspace to go back.
If there is no information, then just click the green button even if no yellow in the text.
If your UI stops before that, choose a different port.