Introduction to technical

Wikimedia world

Toni Hermoso Pulido

@toniher

Amical Wikimedia

#MEMENGINY2018

Wiki

Wikipedia

Wikimedia

MediaWiki

Wiki CMS

Built mostly in:

• PHP
• JavaScript

https://www.mediawiki.org

MediaWiki: Content

Ref

Namespaces

• Main

• Talk

• User

• Category

• Template

https://www.mediawiki.org/wiki/Manual:Namespace

Infoboxes

Infobox in Czech Wikipedia

Templates

MediaWiki functions

https://www.mediawiki.org/wiki/Help:Templates

Templates

Ordered parameters

{{MyTemplate | Hello | World }}

{{{1|Hi}}}, {{{2|Moon}}} !

Template:MyTemplate

Templates

Named parameters

{{MyNamedTemplate | greeting=Hello | recipient=World }}

Template:MyNamedTemplate

{{{greeting|Hi}}}, {{{recipient|Moon}}} !

Bots

The hidden ones

https://www.mediawiki.org/wiki/Manual:Bots

MediaWiki API

Accessing MediaWiki programatically

https://ca.wikipedia.org/w/api.php

https://www.mediawiki.org/wiki/API:Main_page

Pages in 'Enginyers' category in cawiki

Enginyers category

Example:

MediaWiki API clients / libraries

• Perl (MediaWiki::API, MediaWiki::Bot)

• Python (Mwclient, Pywikibot)

• JavaScript (nodemw)

• etc.

https://www.mediawiki.org/wiki/API:Client_code

Infrastructure and resources

Toolforge

Quarry

PAWS

Dumps: SQL, XML, static HTML, etc.

Wikidata

Wikidata: Namespaces

• «Wiki ones»: User, Category, etc.
• Wikibase ones: Item, Property (both Entities)

Special:AllPages

Wikidata: Overview

Reelin

Wikidata: Concepts

• Labels
• Descriptions
• Aliases
• Sitelinks
• Statements
• Qualifiers
• References
• ...

Wikidata Glossary

Wikidata: Statements

https://www.wikidata.org/wiki/Q3454165

Wikidata: Exports

• JSON:
  • https://www.wikidata.org/wiki/Special:EntityData/Q3454165.json
• RDF/XML:
  • https://www.wikidata.org/wiki/Special:EntityData/Q3454165.rdf
• RDF/Turtle:
  • https://www.wikidata.org/wiki/Special:EntityData/Q3454165.ttl
• etc.

Machine-friendly

Wikidata: triples

Paul Schuster was born in Dresden

Wikidata: RDF

(Resource Description Framework)

Wikidata: Querying

SPARQL

SPARQL Protocol and RDF Query Language

Similar to SQL, but for the Semantic Web

Wikidata Query Service

https://query.wikidata.org

Ref

3rd party visualizations: Scholia

https://tools.wmflabs.org/scholia/

3rd party visualizations: Reasonator

https://tools.wmflabs.org/reasonator/

3rd party visualizations: tempo-spatial

https://tools.wmflabs.org/wikidata-todo/tempo_spatial_display.html?

Wikidata: dumps

• JSON
• XML
• RDF
• etc.

https://dumps.wikimedia.org/wikidatawiki

Entities

https://dumps.wikimedia.org/wikidatawiki/entities/

Linked Open Data

http://lod-cloud.net/

Wikimedia ♥ Docker

https://docker.com/

Getting started with Docker

Official or popular Docker images

• Official MediaWiki Docker image
• MediaWiki + other services
• Wikibase (Wikidata software) Docker

Docker images I used in courses

https://github.com/toniher/docker-SemanticMediaWiki

https://github.com/toniher/docker-debian-python-mediawiki

We build the one above following README instructions, modifying Bash scripts and Dockerfile if desired

We can build this one as well. Alternately we can reuse it from:

https://hub.docker.com/r/toniher/debian-python-mediawiki/

However you need to mount example scripts provided in the repo above

Wikimedia Hackathon 2018

Text

May 18 - 20, Escola Enginyeria (UAB)

Wikimedia Hackathon 2018

https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018

May 18 - 20, Escola Enginyeria (UAB)

Participate!

TFG

GSoC

ideas?

hackathon@wikimedia.cat