release notes:
https://releases.openstack.org/caracal/
generic upgrade how-to:
https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade
release notes:
https://releases.openstack.org/caracal/
generic upgrade how-to:
https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Openstack_upgrade
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T53494 Use Beta cluster as a true canary for code deployments (epic) | |||
| Declined | None | T87220 Minimize infrastructure differences between Beta Cluster and production | |||
| Open | None | T276650 Re-consider setting up a Kubernetes cluster on the Beta cluster | |||
| Resolved | Spike | bd808 | T372498 Figure out how to provision a Kubernetes cluster using Magnum and OpenTofu | ||
| Resolved | BUG REPORT | Andrew | T373227 Provisioning of Kubernetes cluster via Magnum stopped working around time of OpenStack upgrade | ||
| Resolved | • rook | T373375 Remove quarry-124 cluster | |||
| Resolved | None | T373093 Update cluster to 1.26 | |||
| Resolved | • rook | T373360 magnum to 1.27 | |||
| Resolved | Andrew | T369044 Upgrade cloud-vps openstack to version 'Caracal' | |||
| Resolved | Andrew | T371707 Update designate sink plugins to work with caracal |
Change #1059408 merged by Andrew Bogott:
[operations/puppet@production] New files, templates and manifests for OpenStack Caracal
Change #1060862 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] Upgrade codfw1dev openstack to version Caracal
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-08T15:49:34Z] <wmbot~andrew@bullseye> START - Cookbook wmcs.openstack.cloudweb.set_maintenance (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-08T15:49:40Z] <wmbot~andrew@bullseye> END (FAIL) - Cookbook wmcs.openstack.cloudweb.set_maintenance (exit_code=99) (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-08T15:50:25Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudweb.set_maintenance (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-08T15:51:07Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudweb.set_maintenance (exit_code=0) (T369044)
Mentioned in SAL (#wikimedia-cloud) [2024-08-08T15:51:15Z] <andrewbogott> upgrading codfw1dev to openstack version caracal https://phabricator.wikimedia.org/T369044
Change #1060862 merged by Andrew Bogott:
[operations/puppet@production] Upgrade codfw1dev openstack to version Caracal
Change #1060892 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[cloud/wmcs-cookbooks@main] upgrade_openstack_node: add 'glance db load_metadefs'
Change #1060892 merged by Andrew Bogott:
[cloud/wmcs-cookbooks@main] upgrade_openstack_node: add 'glance db load_metadefs'
Change #1064771 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] Openstack eqiad1: upgrade to 2024.1 'caracal'
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T16:36:28Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudweb.set_maintenance (T369044)
Change #1064771 merged by Andrew Bogott:
[operations/puppet@production] Openstack eqiad1: upgrade to 2024.1 'caracal'
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T16:38:30Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudweb.set_maintenance (exit_code=0) (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T16:39:04Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudservices1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T16:52:09Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudservices1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T16:52:30Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudservices1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:02:39Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudservices1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:04:13Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudservices1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:13:24Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=99) on host 'cloudservices1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:15:26Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudservices1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:25:09Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudservices1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:25:40Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:38:20Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=99) on host 'cloudcontrol1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:42:49Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:52:44Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T17:54:56Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:10:48Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:12:59Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1007.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:32:29Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1007.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:33:01Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:43:27Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet1006.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:43:43Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T18:53:49Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet1005.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:00:14Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1052' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:00:19Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=99) on host 'cloudvirt1052' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:00:38Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1033' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:00:42Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=99) on host 'cloudvirt1033' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:01:22Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1033.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:08:52Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1033.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:13:58Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1035' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:03Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=99) on host 'cloudvirt1035' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:07Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1037' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:11Z] <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=99) on host 'cloudvirt1037' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:15Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1039' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:19Z] <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=97) on host 'cloudvirt1039' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:14:31Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1035.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:15:02Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudweb.unset_maintenance (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:17:04Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudweb.unset_maintenance (exit_code=0) (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:21:39Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1035.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:21:49Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1037.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:28:41Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1037.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:28:49Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1039.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:35:02Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1039.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:35:07Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1034.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:42:40Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1034.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:42:46Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1036.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:49:25Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1036.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:49:30Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1040.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:56:02Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1040.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T19:56:08Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1045.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:02:52Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1045.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:02:57Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1043.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:09:21Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1043.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:09:26Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1046.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:15:56Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1046.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:16:01Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1041.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:22:33Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1041.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:22:39Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1044.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:29:17Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1044.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:29:22Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1042.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:36:25Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1042.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:36:30Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1038.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:43:46Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1038.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:43:52Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1047.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T20:46:08Z] <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=97) on host 'cloudvirt1047.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T21:14:17Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudweb.set_maintenance (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-22T21:16:19Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudweb.set_maintenance (exit_code=0) (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-23T14:42:13Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1062.eqiad.wmnet' (T369044)
Mentioned in SAL (#wikimedia-cloud-feed) [2024-08-23T14:48:42Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1062.eqiad.wmnet' (T369044)