Page MenuHomePhabricator

Allow continuing Wikidata entity dumps
Closed, ResolvedPublic

Description

If a Wikidata entity dump is being aborted, a subsequent run should be able to pick up where it left. This will work by checking what temp files are already present, and setting the respective batch parameters based on that.

This should (probably) be usable by adding a --continue parameter to dumpwikidatajson.sh or dumpwikidatardf.sh respectively. If that is not present, the old temp files should be deleted.

Event Timeline

hoo triaged this task as High priority.May 2 2018, 11:11 PM
hoo created this task.

Change 430604 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[operations/puppet@production] Wikidata entity dumps: Allow continuing

https://gerrit.wikimedia.org/r/430604

Change 430604 merged by ArielGlenn:
[operations/puppet@production] Wikidata entity dumps: Allow continuing

https://gerrit.wikimedia.org/r/430604

hoo claimed this task.
hoo moved this task from Needs Review to Done on the Wikidata-Ministry-Of-Magic board.
hoo removed a project: Patch-For-Review.
Vvjjkkii renamed this task from Allow continuing Wikidata entity dumps to 3qdaaaaaaa.Jul 1 2018, 1:12 AM
Vvjjkkii reopened this task as Open.
Vvjjkkii removed hoo as the assignee of this task.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed subscribers: gerritbot, Aklapper.
ArielGlenn renamed this task from 3qdaaaaaaa to Allow continuing Wikidata entity dumps.Jul 1 2018, 1:17 PM
ArielGlenn closed this task as Resolved.
ArielGlenn assigned this task to hoo.
ArielGlenn updated the task description. (Show Details)
ArielGlenn added subscribers: gerritbot, Aklapper.