Talking to "Alexa"
Talking to “Alexa”
Roland Foster, Jr.
Learning how to speak her language
Edward Sarrazin
Learning how to speak her language
&
Overview
This presentation is meant to inspire the exploration of new technologies such as Natural Language Processing (NLP) . NLP is currently being used in the home by way of the Amazon Echo, Siri and later this fall Google Home. During this talk, we will explore how this technology is being used with “Alexa” for Home Automation and development on the Amazon AVS platform.
Overview of NLP Concepts.
Core Fuctionality of Alexa and Echo
Doing more.
Design, Development and Deployment of an Alexa Skill.
Talking to “Alexa”
Learning how to speak her language
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128500/alexaLogo.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128551/alexaLogoApp.png)
Sessions
Talking to “Alexa”
•What is an NLP?
•So, Who is Alexa and why does she have an echo?
•I said, “Representative!”
•Echo Demo (Core Features)
•Are you thinking what I’m thinking?
•Smart Devices do Dumb Task
•My TV and Alexa are Friends on IFTTT
•Let there be light!
Joshua: Shall we play a game? : War Games, 1983
Natural Language Processing (NLP)
The interactions between Humans and computers through (Natural) Languages [spoken/textual]. This is a subset of the larger area of Artificial Intelligence (AI) and Computation Linguistics (stats and rules modeling of a natural language).
- HAL , 2001: A Space Odyssey 1968
- Nest, Roland’s Home Yesterday
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128492/sorryDave.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128506/nest.png)
NLP: Amazon
- I’m so, hip and cool. Amazon November 2014
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128493/amazonPrime.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128494/eyeglasses.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128519/echosmall.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128500/alexaLogo.png)
So, Who is Alexa and why does she have an echo.
•Alexa - Alexa Voice Service (AVS). Alexa is the development Platform used for NLP.
•Echo client input/output for Alexa.
•Digital Assistant.
- You sent me. Terminator 2: Judgement Day, 1991
Echo Alexa interaction model
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128496/talkingface.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128519/echosmall.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128500/alexaLogo.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128499/waveform.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128498/halfloop.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3133203/halfloop_reverse.png)
You
Echo
AVS
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3133202/waveform_reverse.png)
interaction model
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128501/reinvent.png)
re:Invent 2015 Alexa Voice Service Under the Hood
I said, “Representative!”
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128502/myRecapAVS.png)
Doppler effect
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128504/dopplereffect.png)
DEMO
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128515/demoEcho.png)
Are you thinking what I’m thinkin: IOT
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128503/smartTv.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128505/hue.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128506/nest.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128508/lock.png)
Smart devices/dumb task
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128608/the-clapper.jpg)
•The Clapper for 2016.
Home Automation/”The Hub”
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128653/SmartHome.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128509/harmonyHome.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128507/smartthings.png)
Companion Apps
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128513/app1.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128511/app2.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128512/app3.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128510/app4.png)
DEMO Cost
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128519/echosmall.png)
$19 + $99 + $99 = “Cool” or $217.00
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128507/smartthings.png)
https://www.youtube.com/watch?v=-nOSlKr6--U
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3162395/cree-lede.jpg)
My TV and Alexa are Friends on IFTTT
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128518/ifttt.png)
IFTTT
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128519/echosmall.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128514/ifttt-connect.png)
Q and A
![](https://s3.amazonaws.com/media-p.slid.es/uploads/596126/images/3128624/exmachina.jpg)
Any Questions?
Session 2 Agenda
How to Speak her language
•Design Custom Skill
•Development/Deployment Custom Skill
•Testing Custom Skill
Session 2 Links
Lambda home for your account - https://console.aws.amazon.com/lambda/home
Getting started - https://developer.amazon.com/alexa-skills-kit#Ready%20to%20start%3F
Skill samples - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit/docs/using-the-alexa-skills-kit-samples
JS Samples - https://github.com/amzn/alexa-skills-kit-js
Java Samples - https://github.com/amzn/alexa-skills-kit-java
Session 2 Links Cont.
Alexa skill home - https://developer.amazon.com/alexa-skills-kit
Linking another developer account - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit/docs/linking-an-alexa-user-with-a-user-in-your-system
Built in intents - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit/docs/implementing-the-built-in-intents
Voice design handbook - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit/docs/alexa-skills-kit-voice-design-handbook
Certification checklist - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit/docs/alexa-skills-kit-submission-checklist
Talking to "Alex" and How to Speak Her Language
By Roland Foster, Jr.
Talking to "Alex" and How to Speak Her Language
- 382