Annotator

You will have to annotate some data at some point. How will you do it? 

Backstory

You chose this life for yourself, you're a professional, and proud to be an annotator! 

 

You feel entitled to ask all the questions to make your job easier, because your colleagues listen and value your suggestions.

Client explains the problem

 

 

If client is not making eye contact with you, as politely as you wish remind them that this time around you will work all together. 

Let's annotate!

 

This time around we will start by doing some annotations all together. Here is the data.

Make sure to create your own copy of the sheet.

 

 

 

Click ahead

What is in the data?

 

"Some fields are not present on the data provided. I don't see the number of employees or business owner name"

 

 

 

The Client will time box it,

when the time runs out go to next slide

Negotiation

Listen to what the NLP engineer is saying and express your opinion. You know the data best!

Game master will tell you when to move on

What is a cake shop, a cafe, a deli, a bakery?

Can you come up with clear annotation rules that are consistent and make client happy?

 

SPOILER ALERT: NLP will have some ideas. You know the data best! You can prove them wrong. Show them examples of data to prove the rules they come up with and client agrees with are incorrect.

NLP engineer's clever suggestions and your wise replies

Wait for the NLP engineer to propose it. For the Client to agree to it or not. 

If the client agrees, then tell them your wise opinion based on knowing the data

NLP engineer's Rule 1. If it has a cafe in name - it's a cafe

Haha! look at this one: https://www.millefeuille-nyc.com/

 

 

NLP engineer's clever suggestions and your wise replies

Wait for the NLP engineer to propose it. For the Client to agree to it or not. 

If the client agrees, then tell them your wise opinion based on knowing the data

NLP engineer's Rule 1. If it has a cafe in name - it's a cafe

Haha! look at this one: https://www.millefeuille-nyc.com/

 

 

NLP engineer's clever suggestions and your wise replies

Wait for the NLP engineer to propose it. For the Client to agree to it or not. 

If the client agrees, then tell them your wise opinion based on knowing the data

 

NLP engineer's Rule 2. If it has picture of a coffee - it's a coffee shop

Haha! look at this one: https://www.breadsbakery.com/

 

 

NLP engineer's clever suggestions and your wise replies

 

 

NLP engineer's Rule 3. If they sell cakes - it's not a coffee shop, it's a cake shop

Haha! look at this one: http://www.gregoryscoffee.com/about

 

Annotation UI

Listen to what the NLP engineer has to propose.

They are presenting you a new way to collect data.

They will ask you to open the link to the tool they created and explain how to use it. 

 

Link: bit.ly/anno-ui  Add your name.lastname to session to not interfere with other teams

i.e. http://104.197.166.123:8080/?session=yourname 

or http://104.197.166.123:8081/?session=differentname

 Ask your GM which port to use out of 8080, 8081, 8082, 8083, 8084.