Anatomy of data
from the previous episodes
- data does not exist, it is not natural
- data is generated through measurement and scientific/societal/political consensus
- data have different natures: measuring natural phenomena is not equal to measuring human activities (society, economics)
data (pl)/datum (sing) = lat. dare = to give
Daniel Rosenberg: data is not fact (facere - to do), not evidence (videre - to see). Data is rhetoric.
"When a fact is proven false, it ceases to be a fact. False data is data nonetheless."
reality
data
information
knowledge
wisdom
observation/measuring
meaning
understanding
decision
data
information
knowledge
insight
wisdom
conspiracy
researched phenomena
published data
not researched phenomena
not published data
2.5 exabytes/day
2500000000000000000 bytes
1.000.000. terabytes
90% of digital data was produced in the last 2 years
530.000.000 mp3 files
150.000.000 32GB Iphone
90 years HD video
5% of useful data
00100011100011011110001101100001100111100101001101001111001101010100001100111110010101110101010010111010101011110100001011010101110101010110111011101110101011011010101110110101011010110100000101010101011111101010101011011111010001010101101101101010101010101010101010011011011010101010111010101011100101010101111101001000101000101001001010101101010111010101000010101111010101011001011011010101010110111010101000101000001010101110101101011010101000010101010110111010110101010000010101010100100101010110111110101010100000101010101011010100000101010111110101001010101010101010100101011010101010101011010110111101001010101010101000001010100000000101010100110111010101101010000
user friendly data
xls
xlsx
csv
tsv
sps
json
xml
kml
geojson
shp
geotiff
pdf
jpeg
-
search
-
download
-
conversion
-
storage and preparation
-
analysis
-
presentation
-
What is useful/usable/free today, may not be useful/usable/free tomorrow
-
Criminal organizations and state agencies are constantly learning
-
This is only a collection, there are other tools which can be used for the same purposes
-
There is no Swiss knife-like tool, and this is good!
-
Many times you have to use different tools for every little step
-
Google is your friend, and you are not alone - there are hundreds of forums where experts discuss the solutions for specific questions and problems
some remarks
Anatomy of Data
By Attila Bátorfy
Anatomy of Data
- 211