| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T387005 [infra] Toolforge: migrate to Debian Bookworm or later | |||
| Resolved | Andrew | T401812 Migrate WMCS-managed NFS servers off of Bullseye | |||
| Resolved | Andrew | T433426 Replace scratch-1.cloudinfra-nfs with a trixie VM |
Event Timeline
Tests suggest that we can do this without rebooting clients, but access will be weird ('Permission denied') for a few minutes during the transition.
This migration will look like:
sudo cookbook wmcs.nfs.migrate_service --from-host-id 2fd8eb82-33ec-4060-91c6-cc0a90de8994 --to-host-id 18eab0f3-5620-4b29-81c0-e8936643526e --project cloudinfra-nfs --to-host-service-port-name scratch
Mentioned in SAL (#wikimedia-cloud) [2026-08-03T15:14:05Z] <andrewbogott> running the migration cookbook for T433426
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T15:14:14Z] <andrew@cloudcumin1001> START - Cookbook wmcs.nfs.migrate_service (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T15:18:34Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.nfs.migrate_service (exit_code=0) (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T15:39:50Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for all NFS workers (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:05:57Z] <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=97) for all NFS workers (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:07:19Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-68 (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:07:54Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-68 (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:13:35Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-67,tools-k8s-worker-nfs-66 (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:13:39Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=99) for tools-k8s-worker-nfs-67,tools-k8s-worker-nfs-66 (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:13:46Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-66 (T433426)
Mentioned in SAL (#wikimedia-cloud-feed) [2026-08-03T17:24:06Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-66 (T433426)