Page MenuHomePhabricator

improve Wikidata dumps [tracking]
Open, HighPublic

Description

This is a tracking bug for tasks concerning the improvement of Wikidata's dumps.

Related Objects

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
OpenNone
OpenNone
Resolvedhoo
OpenNone
ResolvedJanZerebecki
OpenNone
ResolvedSmalyshev
OpenNone
OpenNone
ResolvedLucie
Resolveddaniel
ResolvedLucie
ResolvedArielGlenn
Resolvedthiemowmde
OpenNone
ResolvedArielGlenn
ResolvedArielGlenn
ResolvedJanZerebecki
Invalidhoo
ResolvedJanZerebecki
Resolvedhoo
ResolvedArielGlenn
StalledNone
OpenNone
OpenNone
DuplicateNone
ResolvedSmalyshev
Resolvedhoo
Resolvedhoo
DeclinedNone
Resolvedhoo
Resolvedhoo
OpenNone
Resolvedhoo
ResolvedSmalyshev
StalledNone
Resolvedhoo
Resolvedhoo
ResolvedSmalyshev
ResolvedLydia_Pintscher
OpenNone
Resolvedhoo
ResolvedArielGlenn
InvalidNone
OpenNone
Resolvedhoo
OpenNone
OpenNone
DuplicateNone

Event Timeline

Lydia_Pintscher raised the priority of this task from to Needs Triage.
Lydia_Pintscher updated the task description. (Show Details)
aude set Security to None.
aude added a subscriber: aude.
Jonas renamed this task from improve Wikidata dumps to improve Wikidata dumps [tracking].Aug 15 2015, 7:25 PM

Hello guys - I am using Wikidata enriched with other data source, I must ingest the entire Wikidata JSON dump in a dev graph database of mine. That's easy (yet time-consuming) but once that's done, I want to keep my copy updated by querying the RecentChanges and LogEvents API endpoints to retrieve de changes/deletes/creates that occurred between two timestamps (I'd do so every few minutes) - that's relatively easy too!

How to get the cutoff timestamp for a given JSON dump? Where is this available or how to figure it out since the modified timestamp and lastrevid fields aren't present in JSON dumps.

@Lazhar: Please do not ask the same question in several tasks. Please see https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team where to ask support questions that are not directly related to the task topic. Thanks for your understanding!