Cataloguing open data with 

philippe duchesne
phd@highlatitud.es
@pduchesne

Data Publishing WG
Smart Flanders
17/10/2019

Who?

  • International non-profit founded in 2004
  • using advocacy, technology and training to promote open knowledge
  • Data management platform for publishing data online
  • Open Source and Community driven
  • Extensible architecture and Rich JSON API

Who?

ckan worldwide

check  ckan.org/instances

Who?

Features

  • Search and discoverability for users
    • Central full-text search
    • Faceted search on main metadata fields
    • Previews and data exploration for most data types

 

  • Data management for publishers
    • ​Metadata edition
    • Workflow and approval
    • Fine grained authorization controls
    • Download and view statistics
    • Structured data storage
  • Interoperability & Standards compliance
    • harvester components for many exchange formats
    • support for metadata standards (e.g. DCAT, ISO19139)
    • compliance with EU directives

 

  • Extensible architecture and APIs for developers
    • Extensible page templates
    • Extensible metadata schema
    • Extension API
    • REST API
    • Specialized extensions: data API, analytics, harvesting, spatial...

Features

extensions

some official CKAN extensions

  • ckanext-qa                

  • ckanext-datastore   

  • ckanext-harvest

  • ckanext-spatial

  • ckanext-scheming

  • ckanext-dcat

  • ckanext-disqus

  • ckanext-pages

  • ...

 

many other community-driven extensions :

https://extensions.ckan.org/

open data quality assesment

data storage

harvesting of remote sources

support for geospatial data

custom metadata schemas

DCAT metadata standard support

enable user comments

CMS functionalities

Features

Architecture

CKAN

Web portal

HTTP interfaces
JSON,RDF,DCAT,ISO,...

Harvesters

remote CKAN

DCAT

ISO

data storage

metadata storage

...

Federation

DCAT

DCAT

ISO

DCAT

Europe

 

 

Belgium

 

 

 

Flanders
 

 

 

 

Municipalities

search : opendata.vlaanderen.be

Examples

statistics : opendata.vlaanderen.be

Examples

visualization : opendata.vlaanderen.be

Examples

visualization : opendata.vlaanderen.be

Examples

custom style : data.surrey.ca

Examples

advanced customization : data.gouv.fr

Examples

many others examples

  • www.europeandataportal.eu
  • data.gov
  • data.gov.uk
  • open.ottawa.ca
  • data.kk.dk
  • daten.berlin.de
  • rotterdamopendata.nl
  • ...

 

  see https://ckan.org/about/instances

Examples

Open source means

  • no license costs, only deployment/maintenance costs
  • either use in-house tech resources, or hire externals

 

Standard deployment

  • small-sized virtual machine
  • junior sysadmin profile with some python skills
  • ~4 hours setup
  • basic styling (colors, logo) easily done through the UI

 

Maintenance

  • regular sysadmin work - CKAN as an application is very stable and does not require specific maintenance skills

 

Deployment & maintenance efforts

Cost

Customization

  • custom extensions, advanced styling
  • seasoned developer
     

Community support

  • Very active and reactive community
  • widely used in many governments and municipalities worldwide --> large community-based documentation
  • benefit from other portals custom work
     

Commercial support

Deployment & maintenance efforts

Cost

philippe duchesne

phd @ highlatitud.es

@ pduchesne

thank you

questions?

check out ckan.org

Cataloguing open data with CKAN

By Philippe Duchesne

Cataloguing open data with CKAN

  • 244