DataMoshing

A Workshop

 

 

Real Body: Professor Laila Shereen Sakr

Data Body: @vj_um_amel

 

 

CODEC

Encoding 101

FORMAT

CODEC

Encoding 101

FORMAT

CODEC

Containers

Compression

Encoding 101

FORMAT

CODEC

How the file is algorithmically compressed

Encoding 101

FORMAT

CODEC

How the file is algorithmically compressed

Encoding 101

Containers - The file that is output after compression

FORMAT

CODEC

H.264

JPEG

VP2

VP3

Encoding 101

.mov

.mp3

.mp4

.swf

 

DataMoshing

A complex technique where the movement in one layer of video is applied to another layer of footage, using lossy compression and removed frames to create a glitchy, psychedelic result. Think of what it looks like when your Netflix stream is dragging and creates a ghost image transition.

DataMoshing

 

The various algorithmic video frames

  • I‑frames are the least compressible but don't require other video frames to decode.
  • P‑frames can use data from previous frames to decompress and are more compressible than I‑frames.
  • B‑frames can use both previous and forward frames for data reference to get the highest amount of data compression.

DataMoshing

 

If an I-frame is corrupted, removed or replaced the data contained in the following P-frames is applied to the wrong picture. For example, if I-frames have been removed and so instead of scenes changing properly you see the motion from a new scene applied to a picture from a previous frame. This process of corrupting, removing or replacing I-frames is a very popular video datamoshing technique and what this tutorial will focus on.

Another video datamoshing technique involves selecting one or more P-frames and duplicating them multiple times consecutively. This results in the same P-frame data being applied to one picture over and over again, accentuating the movement and creating what’s known as a Bloom effect.

DataMoshing

Frame by frame method (originally performed using Avidemux 2.54). Download:


Scripting method (also in Ruby and Phython). We will use the AE Datamosh plugin. Download:

 

Various methods can be found here.

 

 

Thank You

@vj_um_amel

DataMoshing: A Workshop

By VJ Um Amel

DataMoshing: A Workshop

The War, Security, and Digital Media Graduate Working Group - UCSB

  • 610