Controlling apps with your mind

Software architect, consultant, author

Web / Mobile / VR / AR / IoT / AI

The Future

The transition phase

We are the ones who break the rules

We are the ones who make the rules

What is the medium we will use in the future?

Which dimensions

we will use?

VR

AR

Other?

How we should prepare for the transition?

Should we adapt things?

Should we shatter foundations?

Invent new techniques?

The new UX patterns and best practices

What are the very foundations of

UI and UX?

2d medium

cave drawings

We've gone a long way

mobile apps

We fake 3rd dimension

 

XR is adding a new dimension

 

So how we've adapted?

 

Reality-based interactions

Adaptive UI

Actual mind reading

The Known Universe

Neurons in our brain

How do they work?

Dipole

Excitatory neuron releases Glutamate

skull

Electrodes

Dipole

Potential change produce oscilations that can be measured

Research EEG

CHF 13,891.50

Price:

Consumer EEG

250$

Price:

Image source @urish

How do we connect that thing to our brain?

Web bluetooth

Demo

How do we measure things more precisely

bandpassFilter

Epochs

 

FFT

 

Conversion of signal from time domain into frequency domain

Now can we recognise different brain waves?

 

We can react to brainwaves spikes

 

Or feed our brain data to machine learning

 

Demo

 

What's the purpose of all of this?

 

The Future is already here

 

and you are the ones to build it

 

Thank you

@VladimirNovick

https://github.com/vnovick/mind-control-demo

Device: Muse

Drone: Parrot Mambo drone

 

Controlling apps with your mind

By Vladimir Novick

Controlling apps with your mind

Controlling apps with your mind

  • 2,088