See https://wikitech.wikimedia.org/wiki/User:Stashbot
Avatar by Freepik from www.flaticon.com CC 3.0 BY.
See https://wikitech.wikimedia.org/wiki/User:Stashbot
Avatar by Freepik from www.flaticon.com CC 3.0 BY.
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:45:24Z] <toyofuku@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] (duration: 12m 52s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:45:24Z] <toyofuku@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] (duration: 12m 52s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:45:24Z] <toyofuku@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] (duration: 12m 52s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:35:00Z] <toyofuku@deploy1003> toyofuku, jdlrobson: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:35:00Z] <toyofuku@deploy1003> toyofuku, jdlrobson: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:35:00Z] <toyofuku@deploy1003> toyofuku, jdlrobson: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:32:32Z] <toyofuku@deploy1003> Started scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:32:32Z] <toyofuku@deploy1003> Started scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T20:32:32Z] <toyofuku@deploy1003> Started scap sync-world: Backport for [[gerrit:1073836|Enable dark mode for all logged in users on all projects (T370099)]], [[gerrit:1073835|Deploy Vector 2022 on several Wikimedia wikis (T374255)]], [[gerrit:1073839|Limit quick surveys to wikis with messages defined (T374654)]]
Mentioned in SAL (#wikimedia-cloud) [2024-09-18T20:02:06Z] <wmbot~lucaswerkmeister@tools-bastion-13> deployed b9a658f45e (health check for background runner, T374152)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T18:08:01Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 100%: T375050', diff saved to https://phabricator.wikimedia.org/P69310 and previous config saved to /var/cache/conftool/dbconfig/20240918-180800-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:55:49Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073853|Revert^2 "Create group for assigning checkuser-temporary-account right" (T369187)]] (duration: 08m 18s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:52:55Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 75%: T375050', diff saved to https://phabricator.wikimedia.org/P69309 and previous config saved to /var/cache/conftool/dbconfig/20240918-175255-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:49:41Z] <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1073853|Revert^2 "Create group for assigning checkuser-temporary-account right" (T369187)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:47:31Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073853|Revert^2 "Create group for assigning checkuser-temporary-account right" (T369187)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:37:50Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 50%: T375050', diff saved to https://phabricator.wikimedia.org/P69308 and previous config saved to /var/cache/conftool/dbconfig/20240918-173749-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:29:53Z] <sukhe> re-enable puppet on A:cp to finish rolling out T347114
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:29:16Z] <sukhe> re-enable puppet on A:cp to finish rolling out T368755
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:22:44Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 25%: T375050', diff saved to https://phabricator.wikimedia.org/P69306 and previous config saved to /var/cache/conftool/dbconfig/20240918-172243-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:09:19Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2217 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69305 and previous config saved to /var/cache/conftool/dbconfig/20240918-170918-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:09:14Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2216 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69304 and previous config saved to /var/cache/conftool/dbconfig/20240918-170913-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:09:09Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2215 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69303 and previous config saved to /var/cache/conftool/dbconfig/20240918-170909-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:09:03Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69302 and previous config saved to /var/cache/conftool/dbconfig/20240918-170903-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:08:59Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2193 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69301 and previous config saved to /var/cache/conftool/dbconfig/20240918-170858-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:08:50Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2172 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69300 and previous config saved to /var/cache/conftool/dbconfig/20240918-170849-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:08:43Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2140 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69299 and previous config saved to /var/cache/conftool/dbconfig/20240918-170843-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:08:38Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2130 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69298 and previous config saved to /var/cache/conftool/dbconfig/20240918-170838-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:08:33Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2129 (re)pooling @ 100%: T373104', diff saved to https://phabricator.wikimedia.org/P69297 and previous config saved to /var/cache/conftool/dbconfig/20240918-170833-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T17:07:39Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 15%: T375050', diff saved to https://phabricator.wikimedia.org/P69296 and previous config saved to /var/cache/conftool/dbconfig/20240918-170738-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:54:13Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2217 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69294 and previous config saved to /var/cache/conftool/dbconfig/20240918-165412-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:54:08Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2216 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69293 and previous config saved to /var/cache/conftool/dbconfig/20240918-165407-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:54:04Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2215 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69292 and previous config saved to /var/cache/conftool/dbconfig/20240918-165403-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:58Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69291 and previous config saved to /var/cache/conftool/dbconfig/20240918-165357-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:53Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2193 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69290 and previous config saved to /var/cache/conftool/dbconfig/20240918-165352-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:44Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2172 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69289 and previous config saved to /var/cache/conftool/dbconfig/20240918-165344-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:38Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2140 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69288 and previous config saved to /var/cache/conftool/dbconfig/20240918-165337-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:33Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2130 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69287 and previous config saved to /var/cache/conftool/dbconfig/20240918-165332-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:53:28Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2129 (re)pooling @ 75%: T373104', diff saved to https://phabricator.wikimedia.org/P69286 and previous config saved to /var/cache/conftool/dbconfig/20240918-165327-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:52:33Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 10%: T375050', diff saved to https://phabricator.wikimedia.org/P69285 and previous config saved to /var/cache/conftool/dbconfig/20240918-165232-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:42:50Z] <sukhe> sudo cumin "A:cp" 'disable-puppet "merging CR 1073453"': T347114
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:40:20Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]] (duration: 14m 06s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:40:20Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]] (duration: 14m 06s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:39:03Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2216 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69283 and previous config saved to /var/cache/conftool/dbconfig/20240918-163902-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:58Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2215 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69282 and previous config saved to /var/cache/conftool/dbconfig/20240918-163857-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:39:07Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2217 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69284 and previous config saved to /var/cache/conftool/dbconfig/20240918-163907-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:52Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69281 and previous config saved to /var/cache/conftool/dbconfig/20240918-163852-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:48Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2193 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69280 and previous config saved to /var/cache/conftool/dbconfig/20240918-163847-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:43Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2172 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69279 and previous config saved to /var/cache/conftool/dbconfig/20240918-163837-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:35Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2140 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69278 and previous config saved to /var/cache/conftool/dbconfig/20240918-163832-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:27Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2130 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69277 and previous config saved to /var/cache/conftool/dbconfig/20240918-163827-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:38:22Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2129 (re)pooling @ 50%: T373104', diff saved to https://phabricator.wikimedia.org/P69276 and previous config saved to /var/cache/conftool/dbconfig/20240918-163822-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:36:39Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 T375050', diff saved to https://phabricator.wikimedia.org/P69275 and previous config saved to /var/cache/conftool/dbconfig/20240918-163637-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:37:27Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2220 (re)pooling @ 5%: T375050', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20240918-163721-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:34:04Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'Promote db2218 to s7 primary T375050', diff saved to https://phabricator.wikimedia.org/P69274 and previous config saved to /var/cache/conftool/dbconfig/20240918-163404-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:33:25Z] <arnaudb> Starting s7 codfw failover from db2220 to db2218 - T375050
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:28:22Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'Remove db2218 from API/vslow/dump T375050', diff saved to https://phabricator.wikimedia.org/P69273 and previous config saved to /var/cache/conftool/dbconfig/20240918-162822-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:26:17Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:28:31Z] <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:28:31Z] <dreamyjazz@deploy1003> dreamyjazz: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:27:04Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'Set db2218 with weight 0 T375050', diff saved to https://phabricator.wikimedia.org/P69272 and previous config saved to /var/cache/conftool/dbconfig/20240918-162703-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:26:50Z] <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 27 hosts with reason: Primary switchover s7 T375050
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:26:26Z] <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on 27 hosts with reason: Primary switchover s7 T375050
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:26:17Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073844|Autopromote users into checkuser-temporary-account-viewer (T369187 T327913)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:24:07Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2218 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69271 and previous config saved to /var/cache/conftool/dbconfig/20240918-162406-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:24:03Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2217 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69270 and previous config saved to /var/cache/conftool/dbconfig/20240918-162401-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:24:00Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2216 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69269 and previous config saved to /var/cache/conftool/dbconfig/20240918-162357-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:53Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2215 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69268 and previous config saved to /var/cache/conftool/dbconfig/20240918-162351-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:47Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2194 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69267 and previous config saved to /var/cache/conftool/dbconfig/20240918-162346-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:42Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2193 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69266 and previous config saved to /var/cache/conftool/dbconfig/20240918-162341-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:32Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2172 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69265 and previous config saved to /var/cache/conftool/dbconfig/20240918-162331-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:27Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2140 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69264 and previous config saved to /var/cache/conftool/dbconfig/20240918-162326-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:22Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2130 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69263 and previous config saved to /var/cache/conftool/dbconfig/20240918-162321-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:23:17Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'db2129 (re)pooling @ 25%: T373104', diff saved to https://phabricator.wikimedia.org/P69262 and previous config saved to /var/cache/conftool/dbconfig/20240918-162316-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:07:10Z] <topranks> moving servers in codfw rack D6 from asw-d6-codfw to lsw1-d6-codfw T373104
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:01:03Z] <hashar@deploy1003> Finished scap sync-world: Update termbox (mul support) - T373088 (duration: 06m 48s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T16:00:27Z] <topranks> moving servers in codfw rack D5 from asw-d5-codfw to lsw1-d5-codfw T373104
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:54:14Z] <hashar@deploy1003> Started scap sync-world: Update termbox (mul support) - T373088
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:40:15Z] <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 12 hosts with reason: network maintenance T373104
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:39:51Z] <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 0:30:00 on 12 hosts with reason: network maintenance T373104
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:39:22Z] <arnaudb@cumin1002> dbctl commit (dc=all): 'depool db2129 db2130 db2140 db2172 db2187 db2193 db2194 db2215 db2216 db2217 db2218 - T373104', diff saved to https://phabricator.wikimedia.org/P69261 and previous config saved to /var/cache/conftool/dbconfig/20240918-153922-arnaudb.json
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:21:08Z] <denisse> Enable metamonitoring for the alert1002, and alert2002 hosts - T372418
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:08:44Z] <denisse> Resolve alerts DNS queries to alert1002 - T372418
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:03:58Z] <_joe_> uploading conftool 3.2.4 to apt T375059
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:01:44Z] <denisse> Make alert1002 the active host - T372418
Mentioned in SAL (#wikimedia-operations) [2024-09-18T15:00:50Z] <denisse> Disable meta-monitoring for the alert hosts - T372418
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:53:51Z] <elukey@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073503|Swap poolcounter1005 with poolcounter1007 (T332015)]] (duration: 07m 23s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:48:35Z] <elukey@deploy1003> elukey: Backport for [[gerrit:1073503|Swap poolcounter1005 with poolcounter1007 (T332015)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:46:27Z] <elukey@deploy1003> Started scap sync-world: Backport for [[gerrit:1073503|Swap poolcounter1005 with poolcounter1007 (T332015)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:38:37Z] <elukey@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073502|Swap poolcounter1004 with poolcounter1006 (T332015)]] (duration: 07m 15s)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:33:42Z] <elukey@deploy1003> elukey: Backport for [[gerrit:1073502|Swap poolcounter1004 with poolcounter1006 (T332015)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:31:21Z] <elukey@deploy1003> Started scap sync-world: Backport for [[gerrit:1073502|Swap poolcounter1004 with poolcounter1006 (T332015)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:20:33Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:20:33Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:20:33Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:20:33Z] <dreamyjazz@deploy1003> Finished scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:18:16Z] <elukey> restart puppetserver on puppetserver1002 - trashing - T373527
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:09:24Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:09:24Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]]
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:11:53Z] <dreamyjazz@deploy1003> sgimeno, anzx, lucaswerkmeister-wmde, cscott, hnowlan, dreamyjazz: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on
Mentioned in SAL (#wikimedia-operations) [2024-09-18T13:09:24Z] <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1073739|GrowthExperiments: enable Community Updates module in testwiki (T374577)]], [[gerrit:1073487|Check that throttling exceptions use valid public IP addresses (T374980)]], [[gerrit:1073790|Hide temp account IP address viewing right from non-temp account wikis (T369187)]], [[gerrit:1073586|Lift IP cap on 2024-10-07/08 for edit-a-thon (T374964)]]