Shortcut: WD:JSON
Wikidata:Database download
Wikidata offers copies of the available content for anyone to download.
Note that there are also several other methods for accessing structured content from Wikidata, which may not require a complete database dump.
Database dumps
There are several different kinds of data dumps available. Note that while JSON and RDF dumps are considered stable interfaces, XML dumps are not. Changes to the data formats used by stable interfaces are subject to the Stable Interface Policy.
JSON dumps (recommended)
JSON dumps containing all Wikidata entities in a single JSON array can be found under https://dumps.wikimedia.org/wikidatawiki/entities/. The entities in the array are not necessarily in any particular order, e.g., Q2 doesn't necessarily follow Q1. The dumps are being created on a weekly basis.
This is the recommended dump format. Please refer to the JSON structure documentation for information about how Wikidata entities are represented.
Hint: Each entity object (data item or property) is placed on a separate line in the JSON file, so the file can be read line by line, and each line can be decoded separately as an individual JSON object.
Note that the files are using parallel compression, which means that some decompressors cannot reliably unpack the files. If you are using Windows you can use e.g. Bzip2. On *nix systems, use lbzip2 which can decompress Bzip2 in parallel. pbzip2 is not a good choice because it is not able to decompress in parallel files not compressed with pbzip2.
You can currently download a fairly recent dump using a torrent.
wikidata-20220103-all.json.gz (109.04 GiB) on academictorrents.com ( magnet)
JsonDumpReader is a PHP library for reading the dumps. gitlab.com/tozd/go/mediawiki is a Go library for processing Wikipedia and Wikidata dumps.
RDF dumps
First, canonical RDF dumps using the Turtle and NTriples formats can be found under https://dumps.wikimedia.org/wikidatawiki/entities/. The mapping is described here. These full statements are noted as all.
Secondly, so called truthy dumps are provided. They use the nt format. They are in the same format as the full dumps, but limited to direct, truthy statements. Therefore, they do not contain meta data such as qualifiers and references.
The -all dump files contain all entity information in Wikidata with the exception of order (of aliases, of statements, etc.), which is not naturally represented in RDF. The -truthy dump files encode the *best* statements (i.e. the ones with the highest rank of each given (subject, property) pairs) as single RDF triples (qualifiers and references are omitted).
The dumps of Wikidata Lexeme namespace in Turtle and NTriples formats can be found in the same place with lexemes suffix.
For details on the RDF dump format please see the page RDF Dump Format.
Partial RDF dumps
WDumper is a third-party tool to create custom wikidata RDF dumps. Entities and statements may be filtered.
XML dumps
Full XML dumps of Wikidata can be found at https://dumps.wikimedia.org/wikidatawiki/.
Warning: The format of the JSON data embedded in the XML dumps is subject to change without notice, and may be inconsistent between revisions. It should be treated as opaque binary data. It is strongly recommended to use the JSON or RDF dumps instead, which use canonical representations of the data!
Incremental dumps (or Add/Change dumps) for Wikidata are also available for download. These dumps contain stuff that was added in the last 24 hours, reducing the need of having to download the full database dump. These dumps are considerably smaller than the full database dumps
They can be found at https://dumps.wikimedia.org/other/incr/wikidatawiki/.
Old JSON and RDF dumps
Old RDF and JSON dumps can be found on the Internet Archive (Q461):
Data model
The data model can be looked up here. The data model describes the fundamental building blocks of Wikidata's data.
Database schema
An overview over the schema of the database can be found at this page. (This is not the schema of the data in Wikidata.)
License
These databases can be used for personal or commercial use, backups or offline use. All structured data from the main, Property, Lexeme, and EntitySchema namespace is available under the Creative Commons CC0 License. Text in the other namespaces is available under the Creative Commons Attribution/Share-Alike License; additional terms may apply. Media items and other content are available under other licenses, as detailed on their description pages.
See also
- Wikipedia:Big data
- For instructions on retrieving RDF for individual items see the Data access page.