Penpot’s

Whac-A-Mappole

Interactive Video Mapping

made with Godot

by Carlos Padial  (Asturnazari)

 

by Carlos Padial  (Asturnazari)

 

  • real-time interactive video mapping

  • custom surface

  • open source

mapping tool

Interactive scenes

Why Godot?

Hello, I'm Carlos Padial

and I'm a multidisciplinary artist

thanks to my dad,

since I was 8,

who bought a 48k Spectrum

in the late 1980s.

(aka asturnazarí)

When video games didn't load,

I haven't stopped drawing

I spent the afternoon drawing with Basic and Logo Turtle Graphics.

I studied and worked in photography and filmmaking.

I discovered free software and hacker ethics,

and decided that these tools would be a   requirement  in my work.

FLOSS experiments

Kinoraw

a research project on open-source cameras

Jump to Cut

a Blender Addon

to improve the VSE

Random Video

Experiments

also with the VSE

Audiogames

A sound art installation made with

Blender BGE and puredata.

Video Mapping

I am also a member of Telenoika, a collective of audiovisual artists based in Barcelona and pioneers of video mapping.

  • design / concept
  • animation content
  • final editting

 

  • optics calculations
  • light calculations
  • templates

  • pointcloud adquisition
  • surface modelling

I have worked in:

technical

 

artistic

 

Video Mapping

Everything with FLOSS except...

The final image deformation you need to adapt to the projection surface, was not easily achievable using open-source tools.

This brings me to the project I’ve come to show you today.

Warping

The final push I needed to encourage me to develop a video mapping tool came in 2023 during the Godot conference in Munich

 

A final push

I’m referring, of course, to   Raffaele Pica’s talk on viewports.

This really blowed my mind.

If you haven’t seen it yet, do have a look – it’s well worth it.

= 🤯🤯🤯

So, I started developing   my own video mapping tool   using Godot.

 

 

 

 

commission

 

 

 

 

full article at

Surface design

The game loop

A Penpot wall

7 different levels

Animations as a reward

Some bizarre gamification features

thanks to  py4godot

Kinect

Kinect - Level selection menu

Kinect - Opening boxes

Mice as game controllers

It's not a video game, but an art performance!!

two ongoing battles

against time

against unforeseen circumstances

against time

Game

controllers

for warping

you can not delay the party.

I only had 4 hours of deployment.

against unforeseen circumstances

Midi controllers

for enforced

stability

bugs

venue "circumstances"

against unforeseen circumstances

  • audio levels per sound effect

  • color correction per clip

  • shortcuts to any level or animation

  • a message system to talk to players

  • controls to change lights

smooth experience

fast setup tools

Main components

I needed

to build the tool.

A video

player

A warping shader

A video mixer 

with blend modes

A video

player

You all know the problems

with   OGV format

 

It's completely impractical.

After much searching, I found…

A video

player

Eirteam.FFmpeg

GDExtension

As the name suggests, it is an extension that uses   FFmpeg   to play videos within Godot.

I replaced the   default library   with a package licensed under the LGPL

A video

player

Features (not in Eirteam)

  • seek  to any frame and get the frame
  • get  resolution, frame rate, duration of the clip
  • change playback  speed
  • preload  movies in a thread to avoid flickering in the fps
  • alpha  video, HTTPS/TLS streams...

GDE Gozen

After the party...

  • only playback

  • gdextension

  • LGPL (by default)

  • playback and rendering

  • godot app, not an extension

  • GPL license

GDE Gozen                Gozen

vs

Warpeable element

A warping shader

A video mixer

with blend modes

Introducing GDMapp

Coming soon at Itch.io

Whac-a-mappole_GodotCon 2026 talk

By Carlos Padial

Whac-a-mappole_GodotCon 2026 talk

  • 12