Once the raid6 volumes can be safely discarded, use the freed space to increase the size of the maps volume, resume the copy, then return NFS to the maps project.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | MaxSem | T103272 Replacements for a.toolserver.org, b.toolserver.org, c.toolserver.org not available | |||
| Resolved | dschwen | T104417 WikiMiniAtlas (wma.wmflabs.org) is still down | |||
| Resolved | coren | T103358 Labs: increase size of the volume for the maps project and restore | |||
| Resolved | coren | T103265 Labs: Salvage, then remove volumes on labstores' raid6 | |||
| Resolved | coren | T103268 Recover files for project liangent-php | |||
| Resolved | coren | T103350 Recover cssk tool's log files | |||
| Resolved | coren | T103205 Recover homedir of "ci" tool | |||
| Resolved | coren | T103689 Restore some files for tools-magog | |||
| Resolved | coren | T103696 Recover /data/project/home/botbot on bots project | |||
| Resolved | coren | T103708 Recovering my Python files in the root | |||
| Resolved | coren | T103725 Recover files for taxonbot | |||
| Resolved | coren | T104134 Recover some sql queries | |||
| Declined | coren | T105014 Log file needs restored. |
Event Timeline
Comment Actions
Is a time estimation possible until this will be done and the tiles return to projects like Wikivoyage?
Comment Actions
We have now completed the prerequisite, and the restoration process will start shortly. From past experience, this should take between 20 and 30 hours.
Comment Actions
Filesystem is created an in place (on a different set of shelves from tools and others) and the copy is now in progress.
Comment Actions
@coren That's awesome news. Cannot wait to see these maps being up and showing again. Thank you for your work on this.
Comment Actions
This is over 1T done now. The copy is slow because the actual filesystem usage (many tens of millions of small files) is pretty much the worst-case scenario for actual disk I/O since this causes almost exclusively random access.
Comment Actions
This is nearing completion, with only some parts of wma/ left to be restored.
It would be possible to make the filesystem available now, allowing code that does not depend on that directory to be running - but that would expose an incomplete restore of wma that continues being update and I do not know how things would react in that situation?
Comment Actions
The maps project's NFS have been restored, but it is almost certain that a remount (at the least) is required for instances in the project for them to pick it up.
Comment Actions
The instances of the maps project have been rebooted, and properly see their filesystems.
Comment Actions
@coren Affirmative. I just checked if the Maps on e.g. Wikivoyage show up again and indeed they do. Thanks a ton for your effort and help! Very much appreciated this is.