QGIS FULL MOTION VIDEO (FMV)

Fran Raga

franka1986@gmail.com

WORKSHOP

who I am?

Engineer in Geodesy and Cartography

Francisco Raga

Full-Stack GIS Developer

QGIS FULL MOTION VIDEO

What is it?

Plugin for QGIS 3 which allows to analyze, visualize and process videos inside the QGIS environment. QGIS FMV accepts multiple video formats such as mp4, ts, avi, etc. It is also able to extract video frames, to capture the current frame, to plot bitrate and to observe the video metadata with aerial images and more. It also offers the possibility to create reports with video metadata.

 

Motivation

This development arises after observing that there was no free solution for the metadata extraction and video analysis in real time. All solutions are private tools, for this reason, I decided to develop this open source project and, this way, offer this open source alternative to the QGIS and the general community.

 

QGIS FULL MOTION VIDEO

Where does FMV data come from?

•Unmanned Aerial Vehicles (UAV’s; UAS’s, RPV’s, drones)

•Fixed Wing and Helicopter

•Orbital sensors (overhead sensors)

•Vehicle mounted cameras

•Hand-held mobile devices and cameras

•Stationary (persistent surveillance)

 

Who is it for?

  • ISR Defense (Intelligence, Surveillance, and Reconnaissance)

 

  • Army

 

  • Emergencies

 

  • Humanitarian Crises

 

  • Border control patrols

 

  • Anyone who needs to analyze flights

WorkFlows

Find, Analyze and Share video information

What is MISB.

Why is it Important?

The Motion Imagery Standards Board (MISB) was established in accordance with DoD Directive 5105.60 "to formulate, review, and recommend standards for Motion Imagery, associated Metadata, Audio, and other related systems" for the Department of Defense (DoD), Intelligence Community (IC), and National System for Geospatial-Intelligence (NSG). The MISB exists under the Geospatial Intelligence Standards Working Group (GWG) which is operated by the GEOINT Standards Center of Excellence division at NGA.

The MISB meets three times a year (typically February, June and October) in the Washington D.C. metropolitan area. The MISB is comprised of working groups that address different functional areas regarding Motion Imagery.

 

DEMULTIPLEXING VIDEO

The metadata is collected from Uav following a standard​ "UAS Datalink Local Set", ST0601.11"

 

Get MISB Data Parser

KLV Sample

Example of a metadata Key-Length-Value (KLV) packet. It is formed by a key (in orange), the length of the whole packet (in red), and a sequence of metadata. Each metadata is identified by a tag (in yellow), the length of the data (in magenta) and the information itself (in green).

 

Tag 5: Platform Heading Angle  , O5 02 D8 3C

  1. In hexadecimal is 0xD83C,is equal to 'int("0xD83C", 16)' , 55356
  2. Apply the formula. (360/65535) * 55356 = 304.08422980086976 degress

 

MULTIPLEXING DATA

MULTIPLEXING DATA (FMV)

VIDEO

WHAT IS THE QGIS FMV?

Video Metadata (MISB)

 

QGIS ENVIRONMENT

Show me the code!

SUMMARY OF FUNCTIONALITIES

  • Convert videos to other format with KLV

 

  • Extract metadata from video file and parse the results

 

  • Show Platform,trajectory and beams position in real time

 

  • Possibility of extracting parts of the video

 

  • Capture of the current frame

 

  • Extraction of all frames/georeferenced of the video

 

  • Extract lon/lat cursor coordinates

 

  • Apply sobel filters, edge detection

 

  • And more ...

COMPONENTS

  • Video Player
  • Video processors
  • Metadata parser
  • Algorithms

GOALS

  • Translators

 

  • Code Contributors

 

  • Information Contributor

 

  • Core integration in KADAS Albireo (basic GIS Software for the Swiss Army needs, based on QGIS)
     

FUTURE

  • Continue with the development

 

  • Follow search partners​

 

  • Find financing​

 

 

Contributions are welcome!

"Emplear software libre es más divertido si participamos en él !! "

https://github.com/All4Gis/QGISFMV

@fran_raga

QGIS FULL MOTION VIDEO (FMV)

Fran Raga

franka1986@gmail.com

SIG libre 2021

By Fran Raga

SIG libre 2021

QGIS FULL MOTION VIDEO

  • 1,511