Page MenuHomePhabricator

Restart wikidata entity dumps
Closed, ResolvedPublic

Description

The weekly run was shot this morning when vslow db connections stalled due to an unrelated long-running query, see T238199

It can be restarted from wherever it died.

Note that we could face this same issue again in the future, as the underlying problem with that slow query is not resolved.

Event Timeline

As I understand it the long running query comes from a monthly cron job.

hoo claimed this task.

Seems this automatically recovered :)

hoo@snapshot1008:/var/log/wikidatadump$ grep -A 1 -B 1 -rni fail *2020051*
dumpwikidatattl-wikidata-20200511-all-BETA-4.log-30269-
dumpwikidatattl-wikidata-20200511-all-BETA-4.log:30270:(2020-05-13T08:12+00:00) Process for batch 40 of shard 4 failed with exit code 143
dumpwikidatattl-wikidata-20200511-all-BETA-4.log-30271-(2020-05-13T08:27+00:00) Starting batch 40

Just a note for the future: While the individual dump run recovered and eventually produced a dump, the cron itself (which was supposed to start other RDF dump flavours afterwards) got killed.