See https://wikitech.wikimedia.org/wiki/User:Stashbot
Avatar by Freepik from www.flaticon.com CC 3.0 BY.
User Details
User Details
- User Since
- Feb 10 2016, 12:29 AM (465 w, 5 d)
- Roles
- Bot
- Availability
- Available
- IRC Nick
- stashbot
- LDAP User
- Stashbot
- MediaWiki User
- Unknown
Fri, Jan 10
Fri, Jan 10
Stashbot added a comment to T380937: decommission cloudelastic100[5-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-10T22:45:56Z] <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: cloudelastic1005*,cloudelastic1006* for ban hosts prior to decom - bking@cumin2002 - T380937
Stashbot added a comment to T380937: decommission cloudelastic100[5-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-10T22:45:52Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: cloudelastic1005*,cloudelastic1006* for ban hosts prior to decom - bking@cumin2002 - T380937
Stashbot added a comment to T380937: decommission cloudelastic100[5-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-10T22:45:45Z] <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.ban (exit_code=99) Banning hosts: cloudelastic1005,cloudelastic1006 for ban hosts prior to decom - bking@cumin2002 - T380937
Stashbot added a comment to T380937: decommission cloudelastic100[5-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-10T22:45:42Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: cloudelastic1005,cloudelastic1006 for ban hosts prior to decom - bking@cumin2002 - T380937
Stashbot added a comment to T380420: Upgrade Cassandra clusters to v4.1.7.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T20:01:13Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:ml-cache-codfw: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002
Stashbot added a comment to T380420: Upgrade Cassandra clusters to v4.1.7.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T19:43:29Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:ml-cache-codfw: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002
Stashbot added a comment to T380420: Upgrade Cassandra clusters to v4.1.7.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T19:41:15Z] <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:ml-cache-eqiad: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002
Stashbot added a comment to T380420: Upgrade Cassandra clusters to v4.1.7.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T19:23:33Z] <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching A:ml-cache-eqiad: Upgrading to Cassandra 4.1.7 — T380420 - eevans@cumin1002
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T15:34:46Z] <jelto> homer 'cr*codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T15:33:57Z] <jelto> homer 'lsw1-d1-codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T15:33:22Z] <jelto> homer 'lsw1-d5-codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T15:32:45Z] <jelto> homer 'lsw1-d3-codfw*' commit 'T377877'
Stashbot added a comment to T383398: Reorganize and clean existing pc1-pc5 sections.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T13:38:27Z] <marostegui> Move pc2013 to pc4 dbmaint codfw - T383398
Stashbot added a comment to T383398: Reorganize and clean existing pc1-pc5 sections.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T13:30:28Z] <marostegui> Move pc1013 to pc3 dbmaint eqiad - T383398
Stashbot added a comment to T383395: decommission db2126.codfw.wmnet.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T12:22:07Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Remove db2126 from dbctl T383395', diff saved to https://phabricator.wikimedia.org/P71980 and previous config saved to /var/cache/conftool/dbconfig/20250110-122206-marostegui.json
Stashbot added a comment to T383395: decommission db2126.codfw.wmnet.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T12:16:57Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2126 T383395', diff saved to https://phabricator.wikimedia.org/P71979 and previous config saved to /var/cache/conftool/dbconfig/20250110-121657-marostegui.json
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T11:51:49Z] <jelto> homer 'cr*codw*' commit 'T377877'
Stashbot added a comment to T377876: Migrate wikikube-eqiad to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T11:51:38Z] <jelto> homer 'cr*eqiad*' commit 'T377876'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T11:50:53Z] <jelto> homer 'lsw1-d6-codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T11:50:04Z] <jelto> homer 'lsw1-d8-codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T11:49:21Z] <jelto> homer 'lsw1-d5-codfw*' commit 'T377877'
Stashbot added a comment to T383388: decommission db2123.codfw.wmnet.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T10:47:39Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2123 T383388', diff saved to https://phabricator.wikimedia.org/P71969 and previous config saved to /var/cache/conftool/dbconfig/20250110-104739-marostegui.json
Stashbot added a comment to T373579: Productionize db22[21-40].
Mentioned in SAL (#wikimedia-operations) [2025-01-10T10:02:49Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2128 db2228 T373579', diff saved to https://phabricator.wikimedia.org/P71959 and previous config saved to /var/cache/conftool/dbconfig/20250110-100248-marostegui.json
Stashbot added a comment to T383320: Low disk space on the root partition for several Hadoop workers.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T10:02:44Z] <elukey> elukey@cumin1002:~$ sudo cumin -b 20 'an-worker*' 'apt-get clean' (safety to free space and avoid issues on hadoop) - T383320
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T09:19:51Z] <jelto> homer 'lsw1-c6-codfw*' commit 'T377877'
Stashbot added a comment to T377876: Migrate wikikube-eqiad to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T08:20:59Z] <jelto> homer 'lsw1-e3-eqiad*' commit 'T377876'
Stashbot added a comment to T377876: Migrate wikikube-eqiad to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-10T08:15:33Z] <jelto> homer 'cr*eqiad*' commit 'T377876'
Thu, Jan 9
Thu, Jan 9
Stashbot added a comment to T378368: Q2:rack/setup/install cloudelastic101[12].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T23:00:23Z] <inflatador> bking@pcc-db1002.puppet-diffs.eqiad1.wikimedia.cloud sudo -u jenkins-deploy /usr/local/sbin/pcc_facts_processor T378368
Stashbot added a comment to T378368: Q2:rack/setup/install cloudelastic101[12].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T23:00:09Z] <inflatador> bking@puppetserver1001:~$ sudo /usr/local/sbin/puppet-facts-upload --proxy http://webproxy.eqiad.wmnet:8080 T378368
Stashbot added a comment to T378368: Q2:rack/setup/install cloudelastic101[12].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T21:44:24Z] <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Sync cloudelastic1011 status change after Netbox update - bking@cumin2002 - T378368"
Stashbot added a comment to T378368: Q2:rack/setup/install cloudelastic101[12].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T21:43:02Z] <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Sync cloudelastic1011 status change after Netbox update - bking@cumin2002 - T378368"
Stashbot added a comment to T383020: Higher RAM quota for fa-wp VPSs.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T21:09:34Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T383020)
Stashbot added a comment to T383020: Higher RAM quota for fa-wp VPSs.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T21:09:27Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T383020)
Stashbot added a comment to T383020: Higher RAM quota for fa-wp VPSs.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T21:07:53Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T383020)
Stashbot added a comment to T383020: Higher RAM quota for fa-wp VPSs.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T21:07:45Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T383020)
Stashbot added a comment to T382362: 1.44.0-wmf.11 deployment blockers.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T19:34:05Z] <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.11 refs T382362
Stashbot added a comment to T383337: Migrate all CI jobs from bullseye to bookworm or later and drop bullseye testing support.
Mentioned in SAL (#wikimedia-releng) [2025-01-09T18:08:27Z] <James_F> Docker: [node22] Update Node to v22.13.0, & switch base image to bookworm, for T383337
Stashbot added a comment to T340552: Implement and wire-up minimal OpenTelemetry tracing client compatible with OTEL data model.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T17:02:56Z] <cdanis@deploy2002> Finished scap sync-world: Backport for [[gerrit:1109133|group1: enable OpenTelemetry exports (T340552)]] (duration: 14m 22s)
Stashbot added a comment to T383337: Migrate all CI jobs from bullseye to bookworm or later and drop bullseye testing support.
Mentioned in SAL (#wikimedia-releng) [2025-01-09T17:01:06Z] <James_F> Docker: [node20] Update Node to v20.18.1, & switch base image to bookworm, for T383337
Stashbot added a comment to T340552: Implement and wire-up minimal OpenTelemetry tracing client compatible with OTEL data model.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T16:53:42Z] <cdanis@deploy2002> cdanis: Backport for [[gerrit:1109133|group1: enable OpenTelemetry exports (T340552)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Stashbot added a comment to T340552: Implement and wire-up minimal OpenTelemetry tracing client compatible with OTEL data model.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T16:48:33Z] <cdanis@deploy2002> Started scap sync-world: Backport for [[gerrit:1109133|group1: enable OpenTelemetry exports (T340552)]]
Stashbot added a comment to T382362: 1.44.0-wmf.11 deployment blockers.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T16:40:00Z] <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.11 refs T382362
Stashbot added a comment to T380615: Migrate the airflow-search database to Kubernetes.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:46:39Z] <inflatador> bking@an-airflow1005 stopping airflow-search services as part of k8s migration T380615
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:25:24Z] <jelto> homer 'cr*codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:24:35Z] <jelto> homer 'lsw1-c5-codfw*' commit 'T377877'
Stashbot added a comment to T377877: Migrate wikikube-codfw to containerd.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:21:54Z] <jelto> homer 'lsw1-d3-codfw*' commit 'T377877'
Stashbot added a comment to T379892: Initial roll-out of Scribunto library for accessing message bundles.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:04:28Z] <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099725|Enable Translate message bundle Scribunto library on MetaWiki (T379892)]] (duration: 32m 53s)
Stashbot added a comment to T379892: Initial roll-out of Scribunto library for accessing message bundles.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T14:38:51Z] <lucaswerkmeister-wmde@deploy2002> abi, lucaswerkmeister-wmde: Backport for [[gerrit:1099725|Enable Translate message bundle Scribunto library on MetaWiki (T379892)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Stashbot added a comment to T379892: Initial roll-out of Scribunto library for accessing message bundles.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T14:31:35Z] <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1099725|Enable Translate message bundle Scribunto library on MetaWiki (T379892)]]
Stashbot added a comment to T309789: [ceph] Upgrade hosts to bullseye.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T11:46:52Z] <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) (T309789)
Stashbot added a comment to T373579: Productionize db22[21-40].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T10:21:27Z] <marostegui> Move db2187:3312 under db2226 s2 codfw dbmaint T373579
Stashbot added a comment to T373579: Productionize db22[21-40].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T10:20:11Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2126 db2226 T373579', diff saved to https://phabricator.wikimedia.org/P71921 and previous config saved to /var/cache/conftool/dbconfig/20250109-102010-marostegui.json
Stashbot added a comment to T309789: [ceph] Upgrade hosts to bullseye.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-09T10:19:09Z] <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.ceph.osd.depool_and_destroy (T309789)
Stashbot added a comment to T383111: Upgrade haproxy to 2.8.13 on cp hosts.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T09:02:16Z] <vgutierrez> update to haproxy 2.8.13 on component thirdparty/haproxy28 bullseye-wikimedia (apt.wm.o) - T383111
Stashbot added a comment to T381379: Post-creation work for tigwiki.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:53:34Z] <kart_> Updated cxserver to 2025-01-07-045930-production (T377966, T377813, T381379)
Stashbot added a comment to T377966: Make cxserver Logstash logs readable and reliable.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:53:34Z] <kart_> Updated cxserver to 2025-01-07-045930-production (T377966, T377813, T381379)
Stashbot added a comment to T377813: Migrate cxserver code from CommonJS to ESM / ECMAScript.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:53:34Z] <kart_> Updated cxserver to 2025-01-07-045930-production (T377966, T377813, T381379)
Stashbot added a comment to T373579: Productionize db22[21-40].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:51:15Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add db2231 to dbctl depooled T373579', diff saved to https://phabricator.wikimedia.org/P71899 and previous config saved to /var/cache/conftool/dbconfig/20250109-065114-marostegui.json
Stashbot added a comment to T373579: Productionize db22[21-40].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:45:57Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2131 T373579', diff saved to https://phabricator.wikimedia.org/P71898 and previous config saved to /var/cache/conftool/dbconfig/20250109-064556-marostegui.json
Stashbot added a comment to T382569: Productionize es104[1-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:41:18Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1022 T382569', diff saved to https://phabricator.wikimedia.org/P71895 and previous config saved to /var/cache/conftool/dbconfig/20250109-064117-marostegui.json
Stashbot added a comment to T382569: Productionize es104[1-6].
Mentioned in SAL (#wikimedia-operations) [2025-01-09T06:17:24Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es1042 depooled T382569', diff saved to https://phabricator.wikimedia.org/P71892 and previous config saved to /var/cache/conftool/dbconfig/20250109-061724-marostegui.json
Stashbot added a comment to T383269: Wikimedia\Rdbms\DBQueryError: Error 1146: Table 'commonswiki.file' doesn't exist.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T00:43:40Z] <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1109149|filerepo: Fix schema compatibility constant usage (T383269)]] (duration: 13m 34s)
Stashbot added a comment to T383269: Wikimedia\Rdbms\DBQueryError: Error 1146: Table 'commonswiki.file' doesn't exist.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T00:36:29Z] <ladsgroup@deploy2002> ladsgroup, cdanis: Backport for [[gerrit:1109149|filerepo: Fix schema compatibility constant usage (T383269)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Stashbot added a comment to T383269: Wikimedia\Rdbms\DBQueryError: Error 1146: Table 'commonswiki.file' doesn't exist.
Mentioned in SAL (#wikimedia-operations) [2025-01-09T00:30:06Z] <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1109149|filerepo: Fix schema compatibility constant usage (T383269)]]
Wed, Jan 8
Wed, Jan 8
Stashbot added a comment to T383237: Many CI builds failing with ECONNRESET from npmjs.org during install:bridge steps.
Mentioned in SAL (#wikimedia-releng) [2025-01-08T22:07:53Z] <hashar> castor: deleting potentially corrupted npm cache. On integration-castor05: sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/{wmf-quibble-selenium-php74,quibble-vendor-mysql-php74-selenium}/npm # T383237
Stashbot added a comment to T382362: 1.44.0-wmf.11 deployment blockers.
Mentioned in SAL (#wikimedia-operations) [2025-01-08T20:05:58Z] <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.11 refs T382362
Stashbot added a comment to T365571: Rename wikikube worker nodes during OS reimage.
Mentioned in SAL (#wikimedia-operations) [2025-01-08T19:53:53Z] <kamila_> homer 'cr*eqiad*' commit 'T365571'
Stashbot added a comment to T382362: 1.44.0-wmf.11 deployment blockers.
Mentioned in SAL (#wikimedia-operations) [2025-01-08T19:29:02Z] <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.11 refs T382362
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:39:32Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-43 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:34:22Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-43 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:34:18Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-32 (T383238)
Stashbot added a comment to T377040: Turn up PHP 8.1-flavored k8s deployments for all MediaWiki services.
Mentioned in SAL (#wikimedia-operations) [2025-01-08T18:33:26Z] <swfrench@deploy2002> Finished scap sync-world: Deployment to switch migration release files to 8.1 - T377040 (duration: 13m 57s)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:26:13Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-32 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:19:44Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-17 (T383238)
Stashbot added a comment to T377040: Turn up PHP 8.1-flavored k8s deployments for all MediaWiki services.
Mentioned in SAL (#wikimedia-operations) [2025-01-08T18:19:28Z] <swfrench@deploy2002> Started scap sync-world: Deployment to switch migration release files to 8.1 - T377040
Stashbot added a comment to T383252: Bump up quota for wikitextexp to let us spin up a more powerful test server.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:16:25Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T383252)
Stashbot added a comment to T383252: Bump up quota for wikitextexp to let us spin up a more powerful test server.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:16:17Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T383252)
Stashbot added a comment to T383251: Request increased quota for wikitextexp Cloud VPS project.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:15:00Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T383251)
Stashbot added a comment to T383251: Request increased quota for wikitextexp Cloud VPS project.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:14:52Z] <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T383251)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:14:12Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-17 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:14:10Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-1 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:12:26Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-1 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:12:22Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-47 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:06:12Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-47 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:06:09Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-41 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:04:35Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-41 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T18:04:31Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-8 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:59:15Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-8 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:59:11Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-27 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:53:55Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-27 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:53:50Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-67 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:48:33Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-67 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:48:29Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-37 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:43:07Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-37 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:41:14Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-26 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:35:55Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-26 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:33:59Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-76 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:28:39Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-76 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:27:31Z] <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-44 (T383238)
Stashbot added a comment to T383238: [nfs] 2025-01-08 tools-nfs outage.
Mentioned in SAL (#wikimedia-cloud-feed) [2025-01-08T17:22:09Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-44 (T383238)