Controlling apps with your mind
Software architect, consultant, author
Web / Mobile / VR / AR / IoT / AI
The Future
The transition phase
We are the ones who break the rules
We are the ones who make the rules
What is the medium we will use in the future?
Which dimensions
we will use?
VR
AR
Other?
How we should prepare for the transition?
Should we adapt things?
Should we shatter foundations?
Invent new techniques?
The new UX patterns and best practices
What are the very foundations of
UI and UX?
2d medium
cave drawings
We've gone a long way
mobile apps
We fake 3rd dimension
XR is adding a new dimension
So how we've adapted?
Reality-based interactions
Adaptive UI
Actual mind reading
The Known Universe
Neurons in our brain
How do they work?
Dipole
Excitatory neuron releases Glutamate
skull
Electrodes
Dipole
Potential change produce oscilations that can be measured
Research EEG
CHF 13,891.50
Price:
Consumer EEG
250$
Price:
Image source @urish
How do we connect that thing to our brain?
Web bluetooth
Demo
How do we measure things more precisely
bandpassFilter
Epochs
FFT
Conversion of signal from time domain into frequency domain
Now can we recognise different brain waves?
We can react to brainwaves spikes
Or feed our brain data to machine learning
Demo
What's the purpose of all of this?
The Future is already here
and you are the ones to build it
Thank you
@VladimirNovick
https://github.com/vnovick/mind-control-demo
Device: Muse
Drone: Parrot Mambo drone