QGIS FULL MOTION VIDEO (FMV)
Fran Raga
franka1986@gmail.com
WORKSHOP
who I am?
Engineer in Geodesy and Cartography
Francisco Raga
Full-Stack GIS Developer
QGIS FULL MOTION VIDEO
What is it?
Plugin for QGIS 3 which allows to analyze, visualize and process videos inside the QGIS environment. QGIS FMV accepts multiple video formats such as mp4, ts, avi, etc. It is also able to extract video frames, to capture the current frame, to plot bitrate and to observe the video metadata with aerial images and more. It also offers the possibility to create reports with video metadata.
Motivation
This development arises after observing that there was no free solution for the metadata extraction and video analysis in real time. All solutions are private tools, for this reason, I decided to develop this open source project and, this way, offer this open source alternative to the QGIS and the general community.
QGIS FULL MOTION VIDEO
Where does FMV data come from?
•Unmanned Aerial Vehicles (UAV’s; UAS’s, RPV’s, drones)
•Fixed Wing and Helicopter
•Orbital sensors (overhead sensors)
•Vehicle mounted cameras
•Hand-held mobile devices and cameras
•Stationary (persistent surveillance)
Who is it for?
- ISR Defense (Intelligence, Surveillance, and Reconnaissance)
- Army
- Emergencies
- Humanitarian Crises
- Border control patrols
- Anyone who needs to analyze flights
WorkFlows
Find, Analyze and Share video information
What is MISB.
Why is it Important?
The Motion Imagery Standards Board (MISB) was established in accordance with DoD Directive 5105.60 "to formulate, review, and recommend standards for Motion Imagery, associated Metadata, Audio, and other related systems" for the Department of Defense (DoD), Intelligence Community (IC), and National System for Geospatial-Intelligence (NSG). The MISB exists under the Geospatial Intelligence Standards Working Group (GWG) which is operated by the GEOINT Standards Center of Excellence division at NGA.
The MISB meets three times a year (typically February, June and October) in the Washington D.C. metropolitan area. The MISB is comprised of working groups that address different functional areas regarding Motion Imagery.
DEMULTIPLEXING VIDEO
The metadata is collected from Uav following a standard "UAS Datalink Local Set", ST0601.11"
Get MISB Data Parser
KLV Sample
Example of a metadata Key-Length-Value (KLV) packet. It is formed by a key (in orange), the length of the whole packet (in red), and a sequence of metadata. Each metadata is identified by a tag (in yellow), the length of the data (in magenta) and the information itself (in green).
Tag 5: Platform Heading Angle , O5 02 D8 3C
- In hexadecimal is 0xD83C,is equal to 'int("0xD83C", 16)' , 55356
- Apply the formula. (360/65535) * 55356 = 304.08422980086976 degress
MULTIPLEXING DATA
MULTIPLEXING DATA (FMV)
VIDEO
WHAT IS THE QGIS FMV?
Video Metadata (MISB)
QGIS ENVIRONMENT
Show me the code!
SUMMARY OF FUNCTIONALITIES
- Convert videos to other format with KLV
- Extract metadata from video file and parse the results
- Show Platform,trajectory and beams position in real time
- Possibility of extracting parts of the video
- Capture of the current frame
- Extraction of all frames/georeferenced of the video
- Extract lon/lat cursor coordinates
- Apply sobel filters, edge detection
- And more ...
COMPONENTS
- Video Player
- Video processors
- Metadata parser
- Algorithms
GOALS
- Translators
- Code Contributors
- Information Contributor
-
Core integration in KADAS Albireo (basic GIS Software for the Swiss Army needs, based on QGIS)
FUTURE
- Continue with the development
- Follow search partners
- Find financing
Contributions are welcome!
"Emplear software libre es más divertido si participamos en él !! "
https://github.com/All4Gis/QGISFMV
@fran_raga
QGIS FULL MOTION VIDEO (FMV)
Fran Raga
franka1986@gmail.com