Page MenuHomePhabricator
Create Task
Maniphest T381259

Productionize es204[1-6]
Closed, ResolvedPublic
Actions

Description

  • es2041 replaces es2020 es4
  • es2042 replaces es2021 es4
  • es2043 replaces es2022 es4
  • es2044 replaces es2023 es5
  • es2045 replaces es2024 es5
  • es2046 replaces es2025 es5

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Dec 3 2024, 5:57 AM

Change #1099851 merged by Marostegui:

[operations/puppet@production] es2041: Enable notifications

https://gerrit.wikimedia.org/r/1099851

gerritbot added a comment.Dec 3 2024, 6:00 AM

Change #1099865 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add es2041

https://gerrit.wikimedia.org/r/1099865

gerritbot added a comment.Dec 3 2024, 6:01 AM

Change #1099865 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add es2041

https://gerrit.wikimedia.org/r/1099865

Stashbot added a comment.Dec 3 2024, 6:06 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T06:06:15Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2041 depooled T381259', diff saved to https://phabricator.wikimedia.org/P71481 and previous config saved to /var/cache/conftool/dbconfig/20241203-060614-marostegui.json

Stashbot added a comment.Dec 3 2024, 6:08 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T06:08:48Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2041 to es4 with just minimal weight T381259', diff saved to https://phabricator.wikimedia.org/P71482 and previous config saved to /var/cache/conftool/dbconfig/20241203-060847-marostegui.json

Marostegui updated the task description. (Show Details)Dec 3 2024, 6:11 AM
gerritbot added a comment.Dec 3 2024, 6:26 AM

Change #1100008 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize es2042

https://gerrit.wikimedia.org/r/1100008

gerritbot added a comment.Dec 3 2024, 6:32 AM

Change #1100008 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize es2042

https://gerrit.wikimedia.org/r/1100008

Stashbot added a comment.Dec 3 2024, 6:34 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T06:34:08Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es2022 to es4 master T381259', diff saved to https://phabricator.wikimedia.org/P71485 and previous config saved to /var/cache/conftool/dbconfig/20241203-063408-marostegui.json

Maintenance_bot removed a project: Patch-For-Review.Dec 3 2024, 7:30 AM
Stashbot added a comment.Dec 3 2024, 7:57 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T07:57:18Z] <marostegui> Switchover es4 codfw master to es2022 dbmaint (this happened an hour ago) T381259

Marostegui added a comment.Dec 3 2024, 9:21 AM

es2041 is being fully pooled now.

gerritbot added a comment.Dec 3 2024, 11:22 AM

Change #1100079 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize es2046

https://gerrit.wikimedia.org/r/1100079

gerritbot added a project: Patch-For-Review.Dec 3 2024, 11:23 AM

Change #1100079 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize es2046

https://gerrit.wikimedia.org/r/1100079

Maintenance_bot removed a project: Patch-For-Review.Dec 3 2024, 11:30 AM
gerritbot added a comment.Dec 4 2024, 6:10 AM

Change #1100232 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add es2042

https://gerrit.wikimedia.org/r/1100232

gerritbot added a project: Patch-For-Review.Dec 4 2024, 6:10 AM
Marostegui added a comment.Dec 4 2024, 6:10 AM

es2042 and es2046 have been cloned.

gerritbot added a comment.Dec 4 2024, 6:16 AM

Change #1100232 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add es2042

https://gerrit.wikimedia.org/r/1100232

Stashbot added a comment.Dec 4 2024, 6:18 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-04T06:18:22Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2042 to dbctl depooled T381259', diff saved to https://phabricator.wikimedia.org/P71509 and previous config saved to /var/cache/conftool/dbconfig/20241204-061821-marostegui.json

Maintenance_bot removed a project: Patch-For-Review.Dec 4 2024, 6:30 AM
Marostegui updated the task description. (Show Details)Dec 4 2024, 7:46 AM
gerritbot added a comment.Dec 4 2024, 7:48 AM

Change #1100390 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add es2046

https://gerrit.wikimedia.org/r/1100390

gerritbot added a project: Patch-For-Review.Dec 4 2024, 7:48 AM
gerritbot added a comment.Dec 4 2024, 7:52 AM

Change #1100390 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add es2046

https://gerrit.wikimedia.org/r/1100390

Stashbot added a comment.Dec 4 2024, 7:54 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-04T07:54:28Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2046 to es5 depooled T381259', diff saved to https://phabricator.wikimedia.org/P71519 and previous config saved to /var/cache/conftool/dbconfig/20241204-075427-marostegui.json

gerritbot added a comment.Dec 4 2024, 7:55 AM

Change #1100391 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2046: Enable notifications

https://gerrit.wikimedia.org/r/1100391

gerritbot added a comment.Dec 4 2024, 7:56 AM

Change #1100391 merged by Marostegui:

[operations/puppet@production] es2046: Enable notifications

https://gerrit.wikimedia.org/r/1100391

Marostegui updated the task description. (Show Details)Dec 4 2024, 7:57 AM

es2042 and es2046 are being pooled

Maintenance_bot removed a project: Patch-For-Review.Dec 4 2024, 8:30 AM
Stashbot added a comment.Dec 4 2024, 8:51 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-04T08:51:25Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es2020 to es4 master T381259', diff saved to https://phabricator.wikimedia.org/P71530 and previous config saved to /var/cache/conftool/dbconfig/20241204-085124-marostegui.json

gerritbot added a comment.Dec 4 2024, 8:54 AM

Change #1100399 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize es2043

https://gerrit.wikimedia.org/r/1100399

gerritbot added a project: Patch-For-Review.Dec 4 2024, 8:54 AM

Change #1100399 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize es2043

https://gerrit.wikimedia.org/r/1100399

Maintenance_bot removed a project: Patch-For-Review.Dec 4 2024, 9:31 AM
Stashbot added a comment.Dec 4 2024, 9:35 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-04T09:35:20Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es2023 to es5 master T381259', diff saved to https://phabricator.wikimedia.org/P71534 and previous config saved to /var/cache/conftool/dbconfig/20241204-093519-marostegui.json

gerritbot added a comment.Dec 4 2024, 9:38 AM

Change #1100404 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize es2045

https://gerrit.wikimedia.org/r/1100404

gerritbot added a project: Patch-For-Review.Dec 4 2024, 9:38 AM

Change #1100404 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize es2045

https://gerrit.wikimedia.org/r/1100404

Marostegui updated the task description. (Show Details)Dec 4 2024, 9:42 AM
Marostegui added a comment.Dec 4 2024, 9:51 AM

es2043 and es2045 being cloned.

Maintenance_bot removed a project: Patch-For-Review.Dec 4 2024, 10:30 AM
Marostegui added a comment.Dec 4 2024, 3:04 PM

es2045 from es2024 failed. Restarting it

Marostegui added a comment.Dec 5 2024, 5:05 AM

es2045 went down T381549

gerritbot added a comment.Dec 5 2024, 5:07 AM

Change #1100580 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add es2043

https://gerrit.wikimedia.org/r/1100580

gerritbot added a project: Patch-For-Review.Dec 5 2024, 5:07 AM

Change #1100580 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add es2043

https://gerrit.wikimedia.org/r/1100580

Stashbot added a comment.Dec 5 2024, 5:15 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-05T05:15:45Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2043 depooled T381259', diff saved to https://phabricator.wikimedia.org/P71586 and previous config saved to /var/cache/conftool/dbconfig/20241205-051545-marostegui.json

Marostegui updated the task description. (Show Details)Dec 5 2024, 5:16 AM
gerritbot added a comment.Dec 5 2024, 5:40 AM

Change #1100587 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize es2044

https://gerrit.wikimedia.org/r/1100587

Stashbot added a comment.Dec 5 2024, 5:41 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-05T05:41:15Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Promote es2025 to es5 master T381259', diff saved to https://phabricator.wikimedia.org/P71596 and previous config saved to /var/cache/conftool/dbconfig/20241205-054114-marostegui.json

gerritbot added a comment.Dec 5 2024, 5:42 AM

Change #1100587 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize es2044

https://gerrit.wikimedia.org/r/1100587

Marostegui added a comment.Dec 5 2024, 5:45 AM

Starting the transfer from es2023 to es2044

Maintenance_bot removed a project: Patch-For-Review.Dec 5 2024, 6:31 AM
gerritbot added a comment.Dec 6 2024, 5:41 AM

Change #1100887 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add es2044 to dbctl

https://gerrit.wikimedia.org/r/1100887

gerritbot added a project: Patch-For-Review.Dec 6 2024, 5:41 AM

Change #1100887 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add es2044 to dbctl

https://gerrit.wikimedia.org/r/1100887

Stashbot added a comment.Dec 6 2024, 5:44 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-06T05:44:58Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2044 to dbctl depooled T381259', diff saved to https://phabricator.wikimedia.org/P71623 and previous config saved to /var/cache/conftool/dbconfig/20241206-054457-marostegui.json

gerritbot added a comment.Dec 6 2024, 5:47 AM

Change #1100888 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/dns@master] wmnet: Update es4 and es5 CNAME

https://gerrit.wikimedia.org/r/1100888

gerritbot added a comment.Dec 6 2024, 5:48 AM

Change #1100889 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2044: Enable notifications

https://gerrit.wikimedia.org/r/1100889

gerritbot added a comment.Dec 6 2024, 5:49 AM

Change #1100889 merged by Marostegui:

[operations/puppet@production] es2044: Enable notifications

https://gerrit.wikimedia.org/r/1100889

gerritbot added a comment.Dec 6 2024, 5:50 AM

Change #1100888 merged by Marostegui:

[operations/dns@master] wmnet: Update es4 and es5 CNAME

https://gerrit.wikimedia.org/r/1100888

Marostegui updated the task description. (Show Details)Dec 6 2024, 5:50 AM

es2044 being pooled for the first time.

Maintenance_bot removed a project: Patch-For-Review.Dec 6 2024, 6:30 AM
Marostegui added a comment.Dec 9 2024, 10:55 AM

Started the transfer again from es2024 to es2045.

Marostegui closed subtask T381549: es2045 went down: CPU error as Resolved.Dec 10 2024, 8:38 AM
gerritbot added a comment.Dec 10 2024, 8:40 AM

Change #1101799 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] es2045: Enable notifications

https://gerrit.wikimedia.org/r/1101799

gerritbot added a project: Patch-For-Review.Dec 10 2024, 8:40 AM

Change #1101799 merged by Marostegui:

[operations/puppet@production] es2045: Enable notifications

https://gerrit.wikimedia.org/r/1101799

gerritbot added a comment.Dec 10 2024, 8:45 AM

Change #1101802 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances: Add es2045 to dbctl

https://gerrit.wikimedia.org/r/1101802

gerritbot added a comment.Dec 10 2024, 8:46 AM

Change #1101802 merged by Marostegui:

[operations/puppet@production] instances: Add es2045 to dbctl

https://gerrit.wikimedia.org/r/1101802

Stashbot added a comment.Dec 10 2024, 8:48 AM

Mentioned in SAL (#wikimedia-operations) [2024-12-10T08:48:45Z] <marostegui@cumin1002> dbctl commit (dc=all): 'Add es2045 to dbctl T381259', diff saved to https://phabricator.wikimedia.org/P71655 and previous config saved to /var/cache/conftool/dbconfig/20241210-084844-marostegui.json

Marostegui updated the task description. (Show Details)Dec 10 2024, 8:50 AM

es2045 is being pooled. All done.

Marostegui closed this task as Resolved.Dec 10 2024, 8:50 AM
Maintenance_bot moved this task from In progress to Done on the DBA board.Dec 10 2024, 9:29 AM
Maintenance_bot removed a project: Patch-For-Review.Dec 10 2024, 9:31 AM
gerritbot added a comment.Jan 6 2025, 6:12 AM

Change #1108309 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] backup2002.cnf.erb: Replace es2022 with es2043

https://gerrit.wikimedia.org/r/1108309

gerritbot added a project: Patch-For-Review.Jan 6 2025, 6:12 AM
gerritbot added a comment.Jan 6 2025, 6:14 AM

Change #1108309 merged by Marostegui:

[operations/puppet@production] backup2002.cnf.erb: Replace es2022 with es2043

https://gerrit.wikimedia.org/r/1108309

Maintenance_bot removed a project: Patch-For-Review.Jan 6 2025, 6:30 AM
gerritbot added a comment.Jan 6 2025, 6:30 AM

Change #1108312 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] backup2002.cnf.er: Replace es2025 with es2046

https://gerrit.wikimedia.org/r/1108312

gerritbot added a project: Patch-For-Review.Jan 6 2025, 6:30 AM
gerritbot added a comment.Jan 6 2025, 6:33 AM

Change #1108312 merged by Marostegui:

[operations/puppet@production] backup2002.cnf.erb: Replace es2025 with es2046

https://gerrit.wikimedia.org/r/1108312

Marostegui closed subtask T381848: Decommission es202[0-5] as Resolved.Jan 8 2025, 8:45 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits