Page MenuHomePhabricator

Productionize db21[88-95]
Open, MediumPublic

Description

These hosts are new:

reimageproductionizehostnamesection source host note
[x][x]db2188s1db2146repooled
[x][x]db2189s2db2175repooled
[x][x]db2190s3db2149repooled
[x][x]db2191x1db2131dest-repooling
[x][x]db2192s5db2178repooled
[x][x]db2193s6db2180repooled
[x][]db2194s7db2169Multi-instance - will implement cookbook first
[x][x]db2195s8db2181repooled

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:05:34Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2193.codfw.wmnet with reason: provisionning db2193.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:07:43Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2180 in db2193 for T343674', diff saved to https://phabricator.wikimedia.org/P53624 and previous config saved to /var/cache/conftool/dbconfig/20231120-120743-arnaudb.json

Change 975751 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: fix mariadb::shard missing error

https://gerrit.wikimedia.org/r/975751

Change 975751 merged by Arnaudb:

[operations/puppet@production] mariadb: fix mariadb::shard missing error

https://gerrit.wikimedia.org/r/975751

Change 975752 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: add a new host on s5

https://gerrit.wikimedia.org/r/975752

Change 975752 merged by Arnaudb:

[operations/puppet@production] mariadb: add a new host on s5

https://gerrit.wikimedia.org/r/975752

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:43:51Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2178.codfw.wmnet with reason: provisionning db2192.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=39a5b516-2f1b-4018-becd-145df4c3af15) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2192.codfw.wmnet - T343674

db2178.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:44:05Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2178.codfw.wmnet with reason: provisionning db2192.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:44:09Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2192.codfw.wmnet with reason: provisionning db2192.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=994e5d1f-bf3c-49b7-afea-cbbfe2d46b7a) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2192.codfw.wmnet - T343674

db2192.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:44:22Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2192.codfw.wmnet with reason: provisionning db2192.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-20T12:45:22Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2178 in db2192 for T343674', diff saved to https://phabricator.wikimedia.org/P53629 and previous config saved to /var/cache/conftool/dbconfig/20231120-124522-arnaudb.json

Change 975927 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: repool db2178

https://gerrit.wikimedia.org/r/975927

Change 975927 merged by Arnaudb:

[operations/puppet@production] mariadb: repool db2178

https://gerrit.wikimedia.org/r/975927

Change 975931 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/cookbooks@master] mariadb: bugfix mysql_upgrade

https://gerrit.wikimedia.org/r/975931

Change 975931 merged by Arnaudb:

[operations/cookbooks@master] mariadb: bugfix mysql_upgrade

https://gerrit.wikimedia.org/r/975931

Change 976709 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/cookbooks@master] mariadb: cookbook draft to clone multiinstance

https://gerrit.wikimedia.org/r/976709

Change 976946 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: enable notifications

https://gerrit.wikimedia.org/r/976946

Change 976946 merged by Arnaudb:

[operations/puppet@production] mariadb: enable notifications

https://gerrit.wikimedia.org/r/976946

Change 976947 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: hieradata ordering

https://gerrit.wikimedia.org/r/976947

Change 976947 merged by Arnaudb:

[operations/puppet@production] mariadb: hieradata ordering

https://gerrit.wikimedia.org/r/976947

Change 976948 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: add a new host to s3

https://gerrit.wikimedia.org/r/976948

Change 976948 merged by Arnaudb:

[operations/puppet@production] mariadb: add a new host to s3

https://gerrit.wikimedia.org/r/976948

Mentioned in SAL (#wikimedia-operations) [2023-11-23T09:13:02Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2149.codfw.wmnet with reason: provisionning db2190.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=a274b2a3-ebf0-47be-b088-1108c77f4763) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2190.codfw.wmnet - T343674

db2149.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T09:13:17Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2149.codfw.wmnet with reason: provisionning db2190.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T09:13:21Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2190.codfw.wmnet with reason: provisionning db2190.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=6ef2b22d-4772-4840-8113-f486c52e6c23) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2190.codfw.wmnet - T343674

db2190.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T09:13:34Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2190.codfw.wmnet with reason: provisionning db2190.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T09:15:15Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2149 in db2190 for T343674', diff saved to https://phabricator.wikimedia.org/P53736 and previous config saved to /var/cache/conftool/dbconfig/20231123-091514-arnaudb.json

ABran-WMF updated the task description. (Show Details)

Change 976949 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: add a new host on s2

https://gerrit.wikimedia.org/r/976949

Change 976949 merged by Arnaudb:

[operations/puppet@production] mariadb: add a new host on s2

https://gerrit.wikimedia.org/r/976949

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:04:27Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2175.codfw.wmnet with reason: provisionning db2189.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=c9127296-3b7e-42a8-a94b-6d5657753ee2) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2189.codfw.wmnet - T343674

db2175.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:04:53Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2175.codfw.wmnet with reason: provisionning db2189.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:04:57Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2189.codfw.wmnet with reason: provisionning db2189.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=be799e71-bb40-4b0a-9a23-c232d1c23919) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2189.codfw.wmnet - T343674

db2189.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:05:11Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2189.codfw.wmnet with reason: provisionning db2189.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:06:39Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2175 in db2189 for T343674', diff saved to https://phabricator.wikimedia.org/P53737 and previous config saved to /var/cache/conftool/dbconfig/20231123-100638-arnaudb.json

Change 976951 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: add a new host on s1

https://gerrit.wikimedia.org/r/976951

Change 976951 merged by Arnaudb:

[operations/puppet@production] mariadb: add a new host on s1

https://gerrit.wikimedia.org/r/976951

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:27:15Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2146.codfw.wmnet with reason: provisionning db2188.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=0438abe0-8156-469e-9f50-f1678699da4e) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2188.codfw.wmnet - T343674

db2146.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:27:30Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2146.codfw.wmnet with reason: provisionning db2188.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:27:34Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2188.codfw.wmnet with reason: provisionning db2188.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=e1ad0372-13ce-4680-b1b4-7c4524b7214e) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2188.codfw.wmnet - T343674

db2188.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:27:49Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2188.codfw.wmnet with reason: provisionning db2188.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:28:40Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2146 in db2188 for T343674', diff saved to https://phabricator.wikimedia.org/P53738 and previous config saved to /var/cache/conftool/dbconfig/20231123-102840-arnaudb.json

Change 976953 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: new host on S8

https://gerrit.wikimedia.org/r/976953

Change 976953 merged by Arnaudb:

[operations/puppet@production] mariadb: new host on S8

https://gerrit.wikimedia.org/r/976953

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:45:12Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: provisionning db2195.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=7b8e73e7-63a7-4538-94c9-5f95e518e31c) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2195.codfw.wmnet - T343674

db2181.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:45:38Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: provisionning db2195.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:45:42Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: provisionning db2195.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=33ee920c-86dd-4bea-9b97-10cf56a4ecbf) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2195.codfw.wmnet - T343674

db2195.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:45:56Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: provisionning db2195.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T10:47:25Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2181 in db2195 for T343674', diff saved to https://phabricator.wikimedia.org/P53739 and previous config saved to /var/cache/conftool/dbconfig/20231123-104724-arnaudb.json

Change 976954 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: notification toggle on dbhosts

https://gerrit.wikimedia.org/r/976954

Change 976954 merged by Arnaudb:

[operations/puppet@production] mariadb: notification toggle on dbhosts

https://gerrit.wikimedia.org/r/976954

Mentioned in SAL (#wikimedia-operations) [2023-11-23T13:41:09Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2131.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=f43b9f93-e532-491b-b9ec-940b42776b6b) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2191.codfw.wmnet - T343674

db2131.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T13:41:24Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2131.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T13:41:31Z] <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2191.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674

Icinga downtime and Alertmanager silence (ID=7c2310cd-204c-420e-8cb7-a6c3696681de) set by arnaudb@cumin1001 for 1 day, 0:00:00 on 1 host(s) and their services with reason: provisionning db2191.codfw.wmnet - T343674

db2191.codfw.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-11-23T13:41:42Z] <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2191.codfw.wmnet with reason: provisionning db2191.codfw.wmnet - T343674

Mentioned in SAL (#wikimedia-operations) [2023-11-23T13:43:16Z] <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db2131 in db2191 for T343674', diff saved to https://phabricator.wikimedia.org/P53766 and previous config saved to /var/cache/conftool/dbconfig/20231123-134316-arnaudb.json

ABran-WMF updated the task description. (Show Details)

Change 976962 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/puppet@production] mariadb: toggle notifications on cloned hosts

https://gerrit.wikimedia.org/r/976962

Change 976962 merged by Arnaudb:

[operations/puppet@production] mariadb: toggle notifications on cloned hosts

https://gerrit.wikimedia.org/r/976962