Data: Big & Noisy!

http://www.darpa.mil/newsevents/releases/2012/03/29.aspx

Title Text

http://www.komli.com/aunz/content/blog/big-data%E2%80%99s-argyle-principle

Tweet Sentiment Visualization Project: http://www.csc.ncsu.edu/faculty/healey/tweet_viz/tweet_app/

Reviewers thought he said...

Big data can solve everything
There is no need to collect research data, just use what’s out there
The future is predictable, if we have enough data

What he really said...

Consider the limitations of Big Data
Do not expect to predict everything using Big Data
Combine insights from humans and machines

http://www.visioncritical.com/3-tips-big-data-nate-silver-s-signal-and-noise/

2012 HBR ...Data Scientist sexiest job in 21st century

2013 "Big Data" entry in OED

http://sils.unc.edu/sites/default/files/publications/Presentations/Kilgour_Lecture_SILS_Apr10_FINAL.pdf

Taylor, R. S. (1962), The process of asking questions. Amer. Doc., 13: 391–396. doi: 10.1002/asi.5090130405

http://www.gartner.com/newsroom/id/2575515

Scale

or size matters

Books in the Library of Congress represent 235 terabytes of data
1994 conference presentation first mention of petabyte and said "the problems which confront the meteorologist today, will worry the arts and humanities in 10 years time."
A petabyte = 4 Library of Congresses
The Large Hadron Collider generates 1 petabyte of data every second
The Square Kilometre Array will generate 4 petabytes of data every second
2013 = zetabyte (1 zetabyte = 250 billion DVD's)
By 2020, the digital universe will equal 35 zetabytes (or 44 times as big as 2009)

Andrew Prescott: Big Data in the Arts and Humanities

http://www.slideshare.net/burgess1822/big-data-33315804

http://www.cendi.gov/presentations/12_11_12_Wilde_Nature_of_Research.pdf

http://www.humanconnectomeproject.org/

https://www.sciencenews.org/article/big-data-studies-come-replication-challenges

http://spectrum.ieee.org/robotics/artificial-intelligence/machinelearning-maestro-michael-jordan-on-the-delusions-of-big-data-and-other-huge-engineering-efforts

Fast forward to 2015

https://chronicle.com/article/Big-Data-Big-Obstacles/151421/

https://www.sciencenews.org/article/big-data-studies-come-replication-challenges

http://www.gartner.com/newsroom/id/2819918

https://jakevdp.github.io/blog/2014/08/22/hacking-academia/

https://medium.com/thelist/moving-from-data-science-to-data-literacy-a2f181ba4167

Big Data

Humanities, Sciences, Librarians

Digital Humanities

DH Projects

Textual Comparisons
Textual Visualizations
TEI
Media

http://www-personal.umich.edu/~eklanche/digdemog/index.html

https://medium.com/the-physics-arxiv-blog/when-a-machine-learning-algorithm-studied-fine-art-paintings-it-saw-things-art-historians-had-never-b8e4e7bf7d3e

Ref: arxiv.org/abs/1408.3218 : Toward Automated Discovery of Artistic Influence

Text

http://www.industrytap.com/big-data-the-hottest-sector-in-it/23697

Librarians add..

Value

Veracity

http://datapub.cdlib.org/

Data Management

Data and Librarians

Research Data Services

Data Management and DMP's
Teaching data best practices
Institutional Repositories
Open data

Introduction to data managment

Steal this idea: A library instructors' guide to educating students in data management skills by Lisa Johnson and Jon Jeffryes published in C&RL, Sept 2014: 431

Managing your data from the University of Minnesota

https://www.lib.umn.edu/datamanagement