Transparency

&
Open Data

https://slides.com/bobbledavidson/transparency-opendata

G+ Hangout

Transparency index?


  1. what is it?
  2. is it really related to Open Data?

Some Indices


Corruption Perception Index:
  • Transparency International
  • http://cpi.transparency.org/cpi2013/results/

Press Freedom Index:
  • Reporters without borders
  • http://en.rsf.org/press-freedom-index-2013,1054.html


Open Data Index:
  • Open Knowledge Foundation
  • https://index.okfn.org/country

Corruption Perception Index 

  • African Development Bank Governance Ratings
  • Bertelsmann Foundation Sustainable Gov Indicators
  • Bertelsmann Foundation Transformation Index
  • Economist Intelligence Unit Country Risk Ratings
  • Freedom House Nations in Transit
  • Global Insight Country Risk Ratings
  • IMD World Competitiveness Yearbook
  • Political and Economic Risk Consultancy Asian Intel.
  • Political Risk Services International Country Risk Guide
  • Transparency Int. Bribe Payers Survey
  • World Bank - Country Policy and Institutional Assessment
  • World Economic Forum Executive Opinion Survey
  • World Justice Project Rule of Law Index




Let's have a quick look!

Data ACCESS

CPI: Transparency Int
  • 177 countries
  • Download Data Pack
  • Raw and summary data .xls
  • EASY !!!



Data ACCESS

FPI: Reporters without borders
  • 179 countries
  • .pdf download
  • html summary table can be copied and pasted 
  • pretty easy, maybe lacks RAW data


Data ACCESS

ODI: Open Knowledge Foundation
  • 70 countries
  • Lots of source code EASILY available
  • Data HARD to find!
  • .csv and JSON...
  • ...of RAW, non-scored data
  • html table does not copy and paste
  • resort to html scrape. 

Ivory tower?

Cleaning Data

...why couldn't we ID with dialling codes?
Russia/Russian Federation
South Korea/Korea (South)/Korea
Slovakia/Slovak Republic
Taiwan/Taiwan R.O.C.
Ivory Coast/Cote d'Ivoire
East Timor/Timor-Leste
Democratic Republic of Congo/DR Congo
Congo Republic/ Republic of the Congo
Burma/Myanmar
Macedonia/Republic of Macedonia
Korea (North)/North Korea

Joining Data

FPI & CPI share 170 countries
OKFN & CPI share 62 countries
OKFN & FPI share 60 countries

Unique to OKFN
Isle Of Man
Guernsey
Jersey
Bermuda
Cayman Islands
Gibraltar
Virgin Is. British
Saint Kitts & Nevis

Analysis

Spearman Correlation of Rankings

Corruption/Open Data -> 0.52, p=1.1e-5
Press Freedom/Open Data -> 0.57, p=2.5e-6

Corruption/Press Freedom -> 0.62, p=2.2e-16

(p values not corrected for multiple testing)

Analysis-Graphs

HK is pretty good for Press Freedom and Corruption...
...Open Data index correlates with both but HK doesn't fit.

COnclusion


Many more metrics!
(including financial secrecy... HK is 3rd most secret)

General pattern of 'good countries' and 'bad countries'
i.e. same countries score very high/very low in all 3

Open Data Index correlates but ...
...there's a lot of noise
...could do with more samples
and...

ConClusion 2

...Correlation NOT EQUAL to causation!!!

  • Maybe more open countries are perceived as being less corrupt... but are just 'hiding' behind data

  • Is a closed, restricted country a sign of a corrupt one?
  • Does a closed country increase chance of corruption?

    • Transparency

    By bobbledavidson

    Made with Slides.com

    Transparency

    A brief investigation into the links between perceived corruption, freedom of the press and Open Data

    • 370