Anatomy of data

from the previous episodes

  • data does not exist, it is not natural
  • data is generated through measurement and scientific/societal/political consensus
  • data have different natures: measuring natural phenomena is not equal to measuring human activities (society, economics)

data (pl)/datum (sing) = lat. dare = to give

Daniel Rosenberg: data is not fact (facere - to do), not evidence (videre - to see). Data is rhetoric.

 

"When a fact is proven false, it ceases to be a fact. False data is data nonetheless."
 

reality

data

information

knowledge

wisdom

observation/measuring

meaning

understanding

decision

data

information

knowledge

insight

wisdom

conspiracy

researched phenomena
published data

not researched phenomena
not published data

2.5 exabytes/day

2500000000000000000 bytes

1.000.000. terabytes

90% of digital data was produced in the last 2 years

530.000.000 mp3 files

150.000.000 32GB Iphone

90 years HD video

5% of useful data

00100011100011011110001101100001100111100101001101001111001101010100001100111110010101110101010010111010101011110100001011010101110101010110111011101110101011011010101110110101011010110100000101010101011111101010101011011111010001010101101101101010101010101010101010011011011010101010111010101011100101010101111101001000101000101001001010101101010111010101000010101111010101011001011011010101010110111010101000101000001010101110101101011010101000010101010110111010110101010000010101010100100101010110111110101010100000101010101011010100000101010111110101001010101010101010100101011010101010101011010110111101001010101010101000001010100000000101010100110111010101101010000

user friendly data

xls
xlsx
csv
tsv
sps
json
xml
kml
geojson
shp
geotiff
pdf

jpeg

  • search

  • download

  • conversion

  • storage and preparation

  • analysis

  • presentation

  • What is useful/usable/free today, may not be useful/usable/free tomorrow
     

  • Criminal organizations and state agencies are constantly learning
     

  • This is only a collection, there are other tools which can be used for the same purposes
     

  • There is no Swiss knife-like tool, and this is good!
     

  • Many times you have to use different tools for every little step
    ​

  • Google is your friend, and you are not alone - there are hundreds of forums where experts discuss the solutions for specific questions and problems
     

some remarks