Basic data tools for journalists
 

data

information

knowledge

insight

wisdom

conspiracy

00100011100011011110001101100001100111100101001101001111001101010100001100111110010101110101010010111010101011110100001011010101110101010110111011101110101011011010101110110101011010110100000101010101011111101010101011011111010001010101101101101010101010101010101010011011011010101010111010101011100101010101111101001000101000101001001010101101010111010101000010101111010101011001011011010101010110111010101000101000001010101110101101011010101000010101010110111010110101010000010101010100100101010110111110101010100000101010101011010100000101010111110101001010101010101010100101011010101010101011010110111101001010101010101000001010100000000101010100110111010101101010000

user friendly data

xls
xlsx
csv
tsv
sps
json
xml
kml
geojson
shp
geotiff
pdf

jpeg

date year, H, Q, month, days, hours to seconds
geolocation continent, country, region, county, city, lines, polygons, coordinates
string description - names, qualities, categories
measure whole, fraction, decimal
boolean true/false, yes/no

types of data

  • search

  • download

  • conversion

  • storage and preparation

  • analysis

  • presentation

  • What is useful/usable/free now, not sure if it will be useful/usable/free tomorrow
     

  • Criminal organizations and state agencies are learning
     

  • This is only a collection, there are other tools which can be used for the same purposes
     

  • There is no Swiss knife tool, and this is good!
     

  • Many times you have to use different tools for every little step

  • Google is your friend - there are hundreds of forums where experts discuss the solutions for specific questions and problems
     

some remarks

search

processed data

META GLOBAL SPECIAL MARKET RESEARCH NATIONAL
Google Data UN Global Terrorism DB Kantar Public Procurements
Ourworldindata Worldbank Freedom House Gemius Central Statistical Bureau
Nasdaq Data Eurostat RSF Ipsos MET
Eur Data Portal UNESCO TI TNS Tax Bureau
IMF Company Reg Land ownership
NASA OCCRP ALEPH National funds
OECD Átlátszó
FB, Twitter

download

  • Google Spreadsheet Importhtml=

  • ​Google Scraper

  • Import.io

conversion

  • PDFTables https://pdftables.com/

  • Tabula https://tabula.technology/

  • Aconvert https://www.aconvert.com/

  • Zamzar https://www.zamzar.com/

  • Mygeodata https://mygeodata.cloud/

storage and preparation

  • Excel

  • Numbers

  • Openrefine https://openrefine.org/download.html

  • Tableau Prep https://www.tableau.com/products/prep/download

analysis

  • Excel

  • Numbers

  • Mysql

  • ​Tableau Public https://public.tableau.com/en-us/s/

  • ​Power BI

  • IBM Watson 

presentation

  • Google Data Studio​

  • Flourish, Datawrapper, RAWGraphs, PlotDB, Plotly, Highcharts

  • Kepler, QGIS, Mapbox / Google/Google Earth/Timelapse https://earthengine.google.com/timelapse/

  • VIS https://github.com/alephdata/datadesktop, Gephi, Cytoscape

  • Chrono

  • Knightlab Tools https://knightlab.northwestern.edu/projects/

Mapping information - diagrammatic thinking

  • table = visual representation
  • Canva
  • Lucid
  • Gephi
  • Cytoscape
  • VIS Dashboard

Mapping information - chronologic order

  • Chronoflo
  • Sutori
  • Knightlab Timeline

Mapping information - spatial order

  • Google My Maps
  • Google Earth
  • Carto
  • Flourish
  • Kepler/Unfolded
  • ArcGIS Storymap
  • Knightlab Storymap

OSINT

By Attila Bátorfy