A Case Study by
The Centre for Internet & Society
Bangalore, India
Elonnai Hickok . Amber Sinha . Vanya Rakesh . Scott Mason . Vipul Kharbanda . Sunil Abraham
Images by Pooja Saxena
Big Data is still in nascent phases in India. Ways in which Big Data is being envisioned and used in Governance include:
Informing policy and decisions: Ex - MyGov.in is a crowd sourcing platform for citizen opinion and input that leverages Big Data technologies to inform policy decisions.
Improving delivery of government services: Ex - Aadhaar and Digital India seek to improve the delivery of government services through means such as reducing fraud, making delivery more efficient, etc.
Assumptions that have been made about big data from policy documents, news items, and conference presentations include:
Digital India is Government of India’s flagship programme to enhance inter-operability of government services and departments and to transform India into a digital knowledge economy.
The initiative focuses on e-Governance policy initiatives by using ICT to offer solutions, digitally empower citizens and provide government benefits and services transparently.
The Nine pillars of Digital India involve the use of technology in areas like Broadband connectivity, electronic delivery of services by way of e-Kranti initiative, encouraging Open data platform, etc. Other programmes include Digital Locker, eSign, and mygov.in
Mapping three aspects of each scheme
Data Flow and Actors Involved
Scheme Dimensions
Digital India is a part of a trend in governance which focuses on creating platforms and large datasets based on the collection and analysis of large amounts of data.
Modernizing of Government data centres is being done by commercial entities - particularly foreign entities
The lack of interoperability between data sets will stand as a barrier to the success of Digital India and should be a national priority
The UID project was conceived by the Planning Commission under the UIDAI (established in the year 2009).
The objective of the scheme has been to issue a 12-digit unique identification number by the Unique Identification Authority of India (Aadhar card/number) to residents, which can be authenticated and verified online.
The Aadhaar number forms a crucial part of the vision for the Digital India programme.
A draft legislation has been proposed, but not passed. The UIDAI has organizational policies, MOUs, and recommendary policies in place.
UIDAI may face operational challenges and issues with the accuracy of data
In light of the shift towards urban transformation due to massive influx of migrants from villages in India, the Indian Government envisioned building 100 smart cities across the country over the span of five years..
In August this year, 98 smart cities across India have been unveiled for this Project.
The Mission will be operated as a Centrally Sponsored Scheme (CSS) and the Central Government proposes to give financial support to the Mission to the extent of Rs. 48,000 crores over five years (on an average Rs. 100 crore per city per year).
Smart Cities Mission aims to drive economic growth in the country, make the cities livable, inclusive and improve the quality of life.
No specific enabling legislation or policy has been proposed but a draft concept note and a mission document have been published.
In the Smart City scheme, technology is being relied upon to 'smooth over' city level problems.
Smart Cities bring together open data and Big Data.
Smart government by enabling e-governance, improved models for future development, better decision-making, efficient service delivery, and making the government more transparent, participatory and accountable.
Smart people by creating a more informed citizenry and fostering creativity, inclusivity, empowerment and participation.
The timeline for the implementation the Smart City initiative is too short for what it seeks to achieve
The Smart City initiative assumes that the technology is neutral and the reality of urban data politics are not being considered
The Smart City initiative raises questions of socio-spatial consequences
The Smart City initiative has not considered the need for interoperable standards
There is a lack of inter-departmental and organizational cooperation, which is needed
Smart Cities risk exclusion and marginalization
Smart Cities are an example of a western practice being imposed in the Indian context
Smart Cities represent a top-down application of technology
Areas in which India's current data protection standards could be insufficient in a 'Big Data' scenario include:
There are potential legal hurdles in the collection and use of different types of digital data. For example
Decision-Making - Big Data is providing governments and businesses with unprecedented opportunities to create new insights and solutions; becoming more responsive to new opportunities and better able to act quickly - and in some cases preemptively – to deal with emerging threats.
Efficiency and Productivity - By providing the information and analysis needed for organisations to better manage and coordinate their operations; Big Data can help to reduce waste, leading to the better utilization of scarce resources and a more productive workforce. (Kshetri, 2014)
R & D and Innovation - Big Data can help businesses to gain an understanding of how others perceive their products or identify customer demand and adapt their marketing or indeed the design of their products accordingly. (Tucker and Welford, 2014)
Personalisation - By enabling companies to generate in-depth profiles of their customers, Big Data allows businesses to quickly and cost-effectively adapt their services to better meet customer demands. (Tucker and Welford, 2014)
Transparency - Advances in data analytics can give consumers and citizens the knowledge to hold governments and businesses to account, as well as make more informed choices about the products and services they use. ( Brown, Chui, and Manyika, 2011)
Re-identification – Big Data potentially allows for the re-identification of anonymized user data by cross-referencing multiple datasets. (Tene and Polonetsky, 2013)
Collection Limitation and Data Minimization – The proliferation of internet enabled devices as well as Big Data’s inherent need to collect as much data as possible, is making these principles of privacy obsolete (Barocas and Selbst, 2015)
Purpose Limitation – Big Data increasingly requires data to be processed several times for a variety of different purposes undermining this principle of privacy. (Article 29 Data Protection Working Party, 2014)
Access and Correction – The real-time generation and analysis of Big Data is challenging the principles of user access and correction. (Article 29 Data Protection Working Party, 2014)
Notice – As a result of Big Data practices relying on vast amounts of data from numerous sources and the re-use of that data - the principle of notice is changing. (Tene and Polonetsky, 2013)
Opt In-Out – The proliferation of internet-enabled devices, their integration into the built environment and the real-time nature of data collection and analysis means that the opting out of data collection is becoming more difficult. (Oxford Internet Institute, 2015)
“Chilling-Effects” – the normalization of large scale data collection risks producing a widespread perception of ubiquitous surveillance, thereby generating so-called ‘chilling effects’ on user’s behavior and free speech. (Matthews and Tucker, 2015)
Dignitary Harms – the automated nature of Big Data analytics possess the potential to reveal personal or sensitive insights about users.
For many the principle of consent has become unworkable in an age of pervasive data collection. Specifically within the literature the following problems with the consent have been identified.
Cognition
Failure to read/access terms of use policies (inaccessible, click-through etc.)
Failure to understand terms of use policies (illiteracy, complexity of legal terminology etc.)
Failure to fully anticipate or comprehend the potential long-term consequences of providing consent.
Opt-in/out
Binary nature of consent
Effectiveness of opt-out?
Structural Problems
Scale (data minimization, collection limitation)
Aggregation
Purpose Limitation
Counter-productive?
Anti-Competitive – The inevitable inequalities in access to user data between start-ups and large well established companies risks leading to a reduction in competition. (Newman, 2014)
Research – Big Data can create inequalities in access to data for researchers and journalist leading to the inability to replicate experiments or verify findings. (Boyd and Crawford, 2012)
Global Inequality – lower levels of connectivity, poor information infrastructure, under-investment in information technologies and a lack of skills make it far more difficult for the developing world to fully reap the rewards of Big Data, thereby potentially deepening global economic inequality.
Data Dispersion – The duplication and dispersion of data across many different data repositories in order to optimize query processing, makes it more difficult for organizations to locate and secure all items of confidential information.
Honey Pot – The larger the quantities of confidential information stored by companies on their databases the more attractive those databases appear to potential hackers
Injudicious or discriminatory outcomes - faults in the programming of Big Data algorithms or discriminatory assessment criteria can have potentially discriminatory effects, reinforcing existing social inequalities. (Robinson and Yu, 2014)
Lack of Transparency - Given their importance algorithms are closely guarded by companies and often classified as trade secrets, meaning there is very little transparency or accountability regarding chronic lack of accountability and transparency in terms of how Big Data algorithms are programmed or what criteria are used to determine outcomes. (Barocas and Selbst, 2015)
Obfuscation – The sheer quantity of correlations and insights identifiable within data sets can sometimes risk obscuring key insights. (Boyd and Crawford, 2012)
“Apophenia” – a phenomena whereby analysts interpret patterns where none exist, ‘simply because enormous quantities of data can offer connections that radiate in all directions’ (Boyd and Crawford, 2012)
From Causality to Correlation – Big Data’s emphasis on correlative analysis risks leading to an abandonment of the pursuit of causal knowledge in favour of shallow descriptive accounts of scientific phenomena (Boyd and Crawford, 2012)
“End of Theory”?/The Data does NOT speak for itself – suggestions that ‘the data speaks for itself’ neglects domain specific knowledge leading to interpretations which fail to embedded the results within wider scientific debates or knowledge. (Kitchen, 2015)
‘N=all’ – Whilst Big Data may seem to be exhaustive in its scope, it can be considered to be so only in relation to the particular ontological and methodological framework chosen by the researcher. No data set however large can fully account for all information relevant to a given phenomenon, in particular unquantifiable and undatafiable variables.
‘Correlation is enough’ – For many the use of Big Data analytics signals a worrying transition from deductive to inductive reasoning. Although Big Data can demonstrate interesting correlations these patterns alone are not enough to provide an explanatory account of the phenomena.
The Data speaks for itself’ – Despite claims that Big Data can be interpreted by anyone and that all correlations are inherently meaningful, without domain experts to contextualise the results the predictive and explanatory utility of big data is nonetheless limited, and can sometimes lead to spurious conclusions.
Beyond privacy policies, transparency of data flow is critical.
For some schemes there is lack of legal framework for collection and use of data.
Broadly data is being equated as truth and seen as the solution
Public private partnerships complicate issues of liability and data ownership.
Public Private partnerships create a 'black box' around data practices of both the government and private companies.
Because India's data protection standards do not apply to the public sector, transparency of the public private relationship is critical.
https://dl.dropboxusercontent.com/u/14380593/DigitalMoneyInnovationFramework_Bill%26MelindaGatesFoundation.pdf
http://www.researchatsashwaat.com/various_report_files/20140327164528_15th%20LS%20%20Report%20No.%2025.pdf
http://articles.economictimes.indiatimes.com/2015-07-23/news/64773195_1_passport-seva-kendra-psks-indian-passport
http://www.manage.gov.in/studymaterial/e-gov-E.pdf
http://www.icar.org.in/files/reports/icar-dare-annual-reports/2011-12/agriculture-economicst-AR-2011-12.pdf
http://supremecourtofindia.nic.in/ecommittee/action-plan-ecourt.pdf
http://www.dacnet.nic.in/AMMP/CAPSRSVer1.0.pdf
http://ncrb.nic.in/All%20State%20RFP/Uttar%20Pradesh/UP_CCTNS_SI_RFP_Volume_I.pdf
https://bigdata.fairness.io/wp-content/uploads/2014/11/Civil_Rights_Big_Data_and_Our_Algorithmic-Future_v1.1.pdf
https://opengovdata.io/2014/the-bhoomi-program-digital-divides/
http://nlrmpportal.nic.in/sharedDoc/doc/GuidelineNLRMP.pdf
http://www.caclubindia.com/forum/no-of-pan-holders-incometaxindia-167636.asp
http://articles.economictimes.indiatimes.com/2015-02-04/news/58795786_1_data-centres-personal-data-state-data
http://thewire.in/2015/07/04/petition-asks-why-aadhar-is-a-must-to-unlock-modis-digilocker-5466/
http://www.catchnews.com/india-news/the-digital-divide-pros-and-cons-of-modi-s-latest-big-initiative-1435856952.html
http://www.indiatimes.com/news/india/governments-digital-locker-plans-to-store-all-your-records-but-doesnt-seem-as-safe-as-it-should-be-230841.html
http://scroll.in/article/708746/India%27s-plan-to-offer-citizens-digital-lockers-poses-a-privacy-threat,-say-experts
http://link.springer.com/chapter/10.1007%2F978-3-642-32701-8_10#page-1
http://articles.economictimes.indiatimes.com/2014-11-26/news/56490626_1_mygov-digital-india-modi-government
https://uidai.gov.in/images/commdoc/other_doc/uid_doc_30012012.pdf pg.15
https://aadhaar.maharashtra.gov.in/upload/EnglishFAQAADHAAR.pdf
https://www.karnataka.gov.in/nammaaadhaar/documents/Application%20form%20-%20English.pdf
https://uidai.gov.in/images/training/MoU_with_the_State_Governments_version.pdf
https://uidai.gov.in/images/FrontPageUpdates/uid_doc_30012012.pdf
http://www.nasscom.in/big-data-next-big-thing
http://www.nasscom.in/nasscom-big-data-summit-redefining-analytics-landscape-india
http://deity.gov.in/content/scheme-forms
http://deity.gov.in/content/recent-activitiesevents
http://india.smartcitiescouncil.com/system/tdf/india/public_resources/Concept-Note-on-Smart-City-Scheme_0.pdf?file=1&type=node&id=2229
Usha Ramanthan. Decoding the Aadhaar judgment: No more seeding, not till the privacy issues is settled by the court. The Indian Express. August 12th 2015. Available at: http://indianexpress.com/article/blogs/decoding-the-aadhar-judgment-no-more-seeding-not-till-the-privacy-issue-is-settled-by-the-court/
UIDAI. Approach Document for Aadhaar Seeding in Service Delivery Databases. Version 1.0. Available at: https://authportal.uidai.gov.in/static/aadhaar_seeding_v_10_280312.pdf
UIDAI. Standard Protocol Covering the Approach & Process for Seeding Aadhaar Numbers in Service Delivery Databases. Available at: https://uidai.gov.in/images/aadhaar_seeding_june_2015_v1.1.pdf
https://uidai.gov.in/images/training/MoU_with_the_State_Governments_version.pdf
http://deity.gov.in/sites/upload_files/dit/files/Draft-IoT-Policy%20(1).pdf
Amy Liu and Robert Puentes, Delivering on the Promise of India’s Smart Cities, January 2015, Available at : http://www.brookings.edu/research/opinions/2015/01/20-indias-smart-cities-liu-puentes
2014 revision of the World Urbanization Prospects, United Nations, Department of Economic and Social Affairs, July 2014, Available at : http://www.un.org/en/development/desa/publications/2014-revision-world-urbanization-prospects.html
NICO TILLIE AND ROLAND VAN DER HEIJDEN, Rotterdam's Smart City Planner: Using Local and Global Data to Drive Performance,March 2015, Available at : https://publicsectordigest.com/articles/view/1443
IBM Smarter Cities, http://www.ibm.com/smarterplanet/in/en/smarter_cities/overview/
UN Data Revolution Report, http://www.undatarevolution.org/report/
Report by NASSCOM and Accenture, Integrated ICT and Geospatial Technologies Framework for 100 Smart Cities Mission, The report is available at the following link: http://www.nasscom.in/integrated-ict-and-geospatial-technologies-framework-100-smart-cities-mission
Anant Maringanti, Partha Mukhopadhyay, Data, Urbanisation and the City, Economic & Political Weekly EPW may 30, 2015 vol l no 22, Available at : http://www.cprindia.org/sites/default/files/articles/SA_L_22_300515_RUA_Anant_Maringanti,_Partha_Mukhopadhyay.pdf
PARTHA MUKHOPADHYAY,The un-smart city,http://www.india-seminar.com/2015/665/665_partha_mukhopadhyay.htm
Economic Times, Modi government announces 98 smart cities; UP gets maximum number at 13, Aug 27, 2015, Availabe at :http://articles.economictimes.indiatimes.com/2015-08-27/news/65929187_1_jammu-and-kashmir-12-cities-urban-development-venkaiah-naidu
Rex Dong, Building smarter cities with data, September 18, 2015, Available at : http://www.financialexpress.com/article/economy/building-smarter-cities-with-data/137931/
Wayne Rash, Smart Cities Require IoT Data to Boost Efficiency, Sustainability, September 14, 2015, Available at : Smart Cities Require IoT Data to Boost Efficiency, Sustainability
Bernard Marr, How Big Data And The Internet Of Things Create Smarter Cities,MAY 19, 2015 , Available at : http://www.forbes.com/sites/bernardmarr/2015/05/19/how-big-data-and-the-internet-of-things-create-smarter-cities/
Singapore Business News, Making smart cities safer, 29 September 2015, Available at : http://www.eco-business.com/news/making-smart-cities-safer/
BW Smart Cities, Protect the Connected – Smart Cities, Data Analytics and Privacy in India,March 27, 2015 , Available at: http://bwsmartcities.com/protect-the-connected-smart-cities-data-analytics-and-privacy-in-india.html#sthash.QQr8hmq5.PUrxFiNR.dpuf
Sandeep Singh, Smart Cities: Governance first, Jun 27, 2015, Available at : http://indianexpress.com/article/india/india-others/smart-cities-governance-first/
Shubhendu Parth, Internet of Things has a large role to play in smart cities,October 29, 2014, Available at: http://www.governancenow.com/views/interview/ternet-things-has-a-large-role-play-smart-cities#sthash.VARdMCz3.dpuf
Mathew Idiculla, Crafting “smart cities”: India’s new urban vision,22 August 2014, Available at : https://www.opendemocracy.net/openindia/mathew-idiculla/crafting-%E2%80%9Csmart-cities%E2%80%9D-india%E2%80%99s-new-urban-vision
The IT Law Community, The Promise and Perils of Smart Cities, Available at : http://www.scl.org/site.aspx?i=ed42789
Ramesh Mamgain, The road to Smart Cities: Data management,August 21, 2015, Available at : http://www.dqindia.com/the-road-to-smart-cities-data-management/
Rob Kitchin, Data-driven, networked urbanism,10th August, 2015, Available at : http://www.spatialcomplexity.info/files/2015/08/SSRN-id2641802.pdf
Ellis Booker, Cities get smart with Big Data, September 25, 2014, Available at : http://data-informed.com/cities-get-smart-big-data/
Jonathan Bright, How big data is breathing new life into the smart cities concept, July 23, 2015, Available at : http://blogs.oii.ox.ac.uk/policy/how-big-data-is-breathing-new-life-into-the-smart-cities-concept/
Open Source Consortium for Smart Cities India ,Available at http://www.persistent.com/sites/default/files/WP_Open%20Source%20Consortium-prod.pdf
Devika Kohli, How Smart Cities Will Force The Poor Out, Jul 06, 2015, Available at : http://www.youthkiawaaz.com/2015/07/smart-cities-keep-the-poor-out/
Urban planner: 'Smart cities' are problematic, Available at : http://www.dw.com/en/urban-planner-smart-cities-are-problematic/a-18057258
Nalaka Gunawardene,Big data can make South Asian cities smarter,March 31, 2015, Available at : http://www.scidev.net/south-asia/governance/analysis-blog/big-data-can-make-south-asian-cities-smarter.html
Smart Cities, Mission Statement and Guidelines, Ministry of Urban Development, Government of India, June 2015, Available at : http://smartcities.gov.in/writereaddata/SmartCityGuidelines.pdf
India.Gov.in, Smart Cities Mission: A step towards Smart India, Available at : http://india.gov.in/spotlight/smart-cities-mission-step-towards-smart-india
Draft Policy on Internet of Things-2015, Department of Electronics & Information Technology(DeitY) Ministry of Communication and Information Technology Government of India, http://deity.gov.in/sites/upload_files/dit/files/Revised-Draft-IoT-Policy_0.pdf