Page MenuHomePhabricator

Missing Enterprise Dumps from 2022-10-01 run
Closed, ResolvedPublic

Description

Event Timeline

The dumps are there on labstore1006. We'll make sure they get rsynced around tomorrow. This is probably a side effect of the transition to the new clouddumps hosts.

Hmm, dumps are still not available…

Change 840158 had a related patch set uploaded (by Hokwelum; author: Hokwelum):

[operations/puppet@production] Add labstore1006 to dumps distribution active web server

https://gerrit.wikimedia.org/r/840158

labstore100[67] have been replaced by clouddumps100[12]. If there's anything missing from the new dumps servers we need to understand why... labstore100[67] are about to be sent to the recycler.

Change 840213 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] clouddumps1001: profile::dumps::distribution::web::is_primary_server = true

https://gerrit.wikimedia.org/r/840213

Change 840213 merged by Andrew Bogott:

[operations/puppet@production] clouddumps1001: profile::dumps::distribution::web::is_primary_server = true

https://gerrit.wikimedia.org/r/840213

Thank you @Andrew for helping to fix this! and @jberkel the dumps are now available!

Change 840158 abandoned by Hokwelum:

[operations/puppet@production] Add labstore1006 to dumps distribution servers

Reason:

This turned out not to be needed to resolve the bug. more details on the task.

https://gerrit.wikimedia.org/r/840158

Not entirely perfect, there's a missing temp dir that needs to go into the manifests for the clouddumps or any new hosts, patch coming...

Change 844984 had a related patch set uploaded (by Hokwelum; author: Hokwelum):

[operations/puppet@production] Create temporary dir for html dumps

https://gerrit.wikimedia.org/r/844984

I expect so; I've run the script manuallly and all is well, once the above patch goes around (in about 2 minutes from now) we should be good to go.

Change 844984 merged by ArielGlenn:

[operations/puppet@production] Create temporary dir for html dumps

https://gerrit.wikimedia.org/r/844984

ArielGlenn claimed this task.

Pre-emptively closing this again, I expect no further issues.