Page MenuHomePhabricator

Migrate read only external store to MariaDB 10.11
Closed, ResolvedPublic

Description

Migrate RO external store to MariaDB 10.11

  • es1
    • es1032
    • es1027
    • es1029
    • es2028
    • es2032
    • es2030
  • es2
    • es1026
    • es1030
    • es1033
    • es2031
    • es2026
    • es2033
  • es3
    • es1034
    • es1031
    • es1028
    • es2034
    • es2029
    • es2027
  • es4
    • es1041
    • es1042
    • es1043
    • es2043
    • es2042
    • es2041
  • es5
    • es1044
    • es1045
    • es1046
    • es2046
    • es2044
    • es2045

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
operations/dnsmaster+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/dnsmaster+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
operations/dnsmaster+1 -1
operations/puppetproduction+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/dnsmaster+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/dnsmaster+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
operations/puppetproduction+1 -1
Show related patches Customize query in gerrit

Related Objects

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change #1145132 merged by Marostegui:

[operations/puppet@production] es1028: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145132

Change #1145135 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2027: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145135

Change #1145135 merged by Marostegui:

[operations/puppet@production] es2027: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145135

Mentioned in SAL (#wikimedia-operations) [2025-05-14T06:16:51Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es1031 and es2029 to es3 masters T391921', diff saved to https://phabricator.wikimedia.org/P76074 and previous config saved to /var/cache/conftool/dbconfig/20250514-061650-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2025-05-14T06:17:21Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1034 es2034 T391921', diff saved to https://phabricator.wikimedia.org/P76075 and previous config saved to /var/cache/conftool/dbconfig/20250514-061721-marostegui.json

Change #1145454 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1034: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145454

Change #1145454 merged by Marostegui:

[operations/puppet@production] es1034: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145454

Change #1145457 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2034: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145457

Change #1145457 merged by Marostegui:

[operations/puppet@production] es2034: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145457

Mentioned in SAL (#wikimedia-operations) [2025-05-14T06:27:16Z] <marostegui> es3 migrated to MariaDB 10.11 T391921

Mentioned in SAL (#wikimedia-operations) [2025-05-14T07:11:59Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1042 es2042 T391921', diff saved to https://phabricator.wikimedia.org/P76085 and previous config saved to /var/cache/conftool/dbconfig/20250514-071159-marostegui.json

Change #1145759 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1042: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145759

Change #1145759 merged by Marostegui:

[operations/puppet@production] es1042: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145759

Change #1145761 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2042: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145761

Change #1145761 merged by Marostegui:

[operations/puppet@production] es2042: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1145761

Change #1145809 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/dns@master] wmnet: Update es3-master alias

https://gerrit.wikimedia.org/r/1145809

Change #1145809 merged by Marostegui:

[operations/dns@master] wmnet: Update es3-master alias

https://gerrit.wikimedia.org/r/1145809

Mentioned in SAL (#wikimedia-operations) [2025-05-15T04:56:58Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1043 es2041 T391921', diff saved to https://phabricator.wikimedia.org/P76159 and previous config saved to /var/cache/conftool/dbconfig/20250515-045658-marostegui.json

Change #1146171 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1043: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146171

Change #1146171 merged by Marostegui:

[operations/puppet@production] es1043: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146171

Change #1146174 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2041: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146174

Change #1146174 merged by Marostegui:

[operations/puppet@production] es2041: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146174

Mentioned in SAL (#wikimedia-operations) [2025-05-15T05:39:59Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es1042 and es2042 to es4 masters T391921', diff saved to https://phabricator.wikimedia.org/P76167 and previous config saved to /var/cache/conftool/dbconfig/20250515-053958-marostegui.json

Change #1146190 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/dns@master] wmnet: Update es4-master

https://gerrit.wikimedia.org/r/1146190

Change #1146190 merged by Marostegui:

[operations/dns@master] wmnet: Update es4-master

https://gerrit.wikimedia.org/r/1146190

Mentioned in SAL (#wikimedia-operations) [2025-05-15T06:50:40Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1045 es2045 T391921', diff saved to https://phabricator.wikimedia.org/P76176 and previous config saved to /var/cache/conftool/dbconfig/20250515-065039-marostegui.json

Change #1146447 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1045: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146447

Change #1146447 merged by Marostegui:

[operations/puppet@production] es1045: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146447

Change #1146448 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2045: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146448

Change #1146448 merged by Marostegui:

[operations/puppet@production] es2045: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146448

Mentioned in SAL (#wikimedia-operations) [2025-05-15T07:30:33Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1041 es2043 T391921', diff saved to https://phabricator.wikimedia.org/P76186 and previous config saved to /var/cache/conftool/dbconfig/20250515-073033-marostegui.json

Change #1146490 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1041: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146490

Change #1146490 merged by Marostegui:

[operations/puppet@production] es1041: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146490

Change #1146494 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2043: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146494

Change #1146494 merged by Marostegui:

[operations/puppet@production] es2043: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146494

Mentioned in SAL (#wikimedia-operations) [2025-05-16T05:07:07Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1046 es2044 T391921', diff saved to https://phabricator.wikimedia.org/P76228 and previous config saved to /var/cache/conftool/dbconfig/20250516-050707-marostegui.json

Change #1146830 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1046: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146830

Change #1146830 merged by Marostegui:

[operations/puppet@production] es1046: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146830

Change #1146832 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2044: Migrate MariaDB to 10.11

https://gerrit.wikimedia.org/r/1146832

Change #1146832 merged by Marostegui:

[operations/puppet@production] es2044: Migrate MariaDB to 10.11

https://gerrit.wikimedia.org/r/1146832

Mentioned in SAL (#wikimedia-operations) [2025-05-16T06:06:53Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es1045 and es2045 to es5 masters T391921', diff saved to https://phabricator.wikimedia.org/P76236 and previous config saved to /var/cache/conftool/dbconfig/20250516-060652-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2025-05-16T06:16:49Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es2046 es1044 T391921', diff saved to https://phabricator.wikimedia.org/P76239 and previous config saved to /var/cache/conftool/dbconfig/20250516-061649-marostegui.json

Change #1146853 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es1044: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146853

Change #1146853 merged by Marostegui:

[operations/puppet@production] es1044: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146853

Change #1146860 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2046: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146860

Change #1146860 merged by Marostegui:

[operations/puppet@production] es2046: Migrate to MariaDB 10.11

https://gerrit.wikimedia.org/r/1146860

This has been completed.

Change #1146866 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/dns@master] wmnet: Update es5-master

https://gerrit.wikimedia.org/r/1146866

Change #1146866 merged by Marostegui:

[operations/dns@master] wmnet: Update es5-master

https://gerrit.wikimedia.org/r/1146866

es1032 paged us today for mysql being down but then we saw it is depooled and mysql has been down for at least 24 hours.

is that still related to this ticket?

Mentioned in SAL (#wikimedia-operations) [2025-07-15T16:36:28Z] <dzahn@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on es1032.eqiad.wmnet with reason: T391921

Mentioned in SAL (#wikimedia-operations) [2025-07-15T16:36:39Z] <mutante> downtiming es1032 for 3 days - expired downtime for T391921?

es1032 paged us today for mysql being down but then we saw it is depooled and mysql has been down for at least 24 hours.

is that still related to this ticket?

This isn't related to this ticket but to https://phabricator.wikimedia.org/T395241