performing music remotely
Howdy!
I'm Ben Michel (@obensource)
I ♡ MAKING MUSIC
I ♡ WRITING JAVaSCRIPT
because:
My background
- Music Performance (Composition, Performing)
- Audio Engineering (Recording, Signal Processing)
- Application Development (CS, JavaScript, Node.js)
frontend
at ZHealth
live sountracks
local Meetups
Donut.js, PDXNode
let's talk about recording
because of this:
we've gone from
here...
...and here
...and here
to Here:
and here...
and here...
...and here.
and yet,
a different story for music began back in 1957...
MAX MATHEWS
wrote 'music'
The first computer program developed
to perform sound-generation
BASED ON WHAT HE'D LEARNED about THE
NYQUIST-SHANNON SAMPLING THEOREM
(breaking a continuous signal into chunks)
HE DECLARED THAT THE "COMPUTER IS...
a UNIVERSAL musical INSTRUMENT."
A LOT
HAS HAPPENED BETWEEN then & NOW...
synthesis became real!
we can haz all the wayz to synthesize soundz
- Subtractive
- Additive
- FM (Frequency Modulation)
Approaches for sound-generation:
we can haz MIDI
(Musical Instrument Digital Interface)
midi = Performance descriptions, not sound
languages
- Max/MSP
- SuperCollider / ChucK
- CSound
- Faust
- Java / Python
- C++
applications
- Digital Audio Workstations
- Realtime Performance
- Synthesizer Plugins
- Instrument FX
but what about making music in the internet?
We have the internet of audio, but...
since The 'realtime' web began with this decade...
and we have new standard web tools to build audio and midi applications in the browser...
the time for the internet of music
is now
the Web audio api
a sound generation & processing toolset for javascript, native to your browser.
the Web MIDI api
a javascript toolset which can process, send, receive, and generate midi data.
web audio + web MIDI
example
Chris Wilson's – 'Analog' Synth
That was neat, but what about distributed music?
web Audio
+
WEb MIDI
+
REALTIME TECH
(P2P WebRTC Datachannels, WebSockets Broadcasts)
with
sound & performance
information over the network!
we get
we can play music together...
which MEANS
in realtime...
('near-realtime' technically)
from distributed places!
In light of
what Max MAthews said
I now believe...
OH rly?
HOW SO?
because midi.
unlike audio, midi is naturally light-weight
(ultra light-weight)
with the web midi api
distributed midi instruments can be inter-connected
(via JavaScript!)
so imagine...
like srsly everywhere
there are big
problems here
(With the physical internet, in JavaScript, etc)
the biggest: Latency
at best
like trying to play with...
an insanely terrible drummer
But regardless
we can build useful remote performance & collaboration tools
built on the awesomeness of
broadcasting
&
Peer Connections
which expose work-arounds to our speed of light problem
and based on my performance models that humans can use, and browsers can understand
you perform centrally
broadcast remotely
(Rendered via Web Audio)
or to the rest of the band at the venue
or to teach the kids at school
or the kids could make music with and for other kids
Regardless of their distance
or socio-economic divide
it's time to start
thinking about what common music looks like for our global culture
so the next generation might not get lost in a sea of audio
or in a culture which produces this
or just live out the mantras of hyper-consumerism
but they can loose themselves in creating our common culture together
this is why i started
websound
a place to move
the music community forward
(we're an opensource initiative)
and get developers, musicians,
and institues...
talking together
what's the awesome power of web midi look like?
web app DEMO
remote performer
Thank you!
Keep in touch!
Twitter: @obensource, @websoundorg
www.websound.community
Performing Music Remotely
By Ben Michel
Performing Music Remotely
A talk I gave at Instrument (a design agency in Portland, Oregon), which ended with a demo of a live, distributed musical performance (watch here: https://www.youtube.com/watch?v=3PrbBHiTeDs).
- 1,595