Penpot’s
Whac-A-Mappole
Interactive Video Mapping
made with Godot
by Carlos Padial (Asturnazari)
by Carlos Padial (Asturnazari)
-
real-time interactive video mapping
-
custom surface
-
open source
mapping tool
Interactive scenes
Why Godot?
Hello, I'm Carlos Padial
and I'm a multidisciplinary artist
thanks to my dad,
since I was 8,
who bought a 48k Spectrum
in the late 1980s.
(aka asturnazarí)
When video games didn't load,
I haven't stopped drawing
I spent the afternoon drawing with Basic and Logo Turtle Graphics.
I studied and worked in photography and filmmaking.
I discovered free software and hacker ethics,
and decided that these tools would be a requirement in my work.
FLOSS experiments
Kinoraw
a research project on open-source cameras
Jump to Cut
a Blender Addon
to improve the VSE
Random Video
Experiments
also with the VSE
Audiogames
A sound art installation made with
Blender BGE and puredata.
Video Mapping
I am also a member of Telenoika, a collective of audiovisual artists based in Barcelona and pioneers of video mapping.
- design / concept
- animation content
- final editting
- optics calculations
- light calculations
-
templates
- pointcloud adquisition
- surface modelling
I have worked in:
technical
artistic
Video Mapping
Everything with FLOSS except...
The final image deformation you need to adapt to the projection surface, was not easily achievable using open-source tools.
This brings me to the project I’ve come to show you today.
Warping
The final push I needed to encourage me to develop a video mapping tool came in 2023 during the Godot conference in Munich
A final push
I’m referring, of course, to Raffaele Pica’s talk on viewports.
This really blowed my mind.
If you haven’t seen it yet, do have a look – it’s well worth it.
= 🤯🤯🤯
So, I started developing my own video mapping tool using Godot.
commission
full article at
Surface design
The game loop
A Penpot wall
7 different levels
Animations as a reward
Some bizarre gamification features
thanks to py4godot
Kinect
Kinect - Level selection menu
Kinect - Opening boxes
Mice as game controllers
It's not a video game, but an art performance!!
two ongoing battles
against time
against unforeseen circumstances
against time
Game
controllers
for warping
you can not delay the party.
I only had 4 hours of deployment.
against unforeseen circumstances
Midi controllers
for enforced
stability
bugs
venue "circumstances"
against unforeseen circumstances
-
audio levels per sound effect
-
color correction per clip
-
shortcuts to any level or animation
-
a message system to talk to players
-
controls to change lights
smooth experience
fast setup tools
Main components
I needed
to build the tool.
A video
player
A warping shader
A video mixer
with blend modes
A video
player
You all know the problems
with OGV format
It's completely impractical.
After much searching, I found…
A video
player
Eirteam.FFmpeg
GDExtension
As the name suggests, it is an extension that uses FFmpeg to play videos within Godot.
I replaced the default library with a package licensed under the LGPL
A video
player
Features (not in Eirteam)
- seek to any frame and get the frame
- get resolution, frame rate, duration of the clip
- change playback speed
- preload movies in a thread to avoid flickering in the fps
- alpha video, HTTPS/TLS streams...
GDE Gozen
After the party...
-
only playback
-
gdextension
-
LGPL (by default)
-
playback and rendering
-
godot app, not an extension
-
GPL license
GDE Gozen Gozen
vs
Warpeable element
A warping shader
A video mixer
with blend modes
Introducing GDMapp
