Page MenuHomePhabricator
Create Task
Maniphest T362509

Setup new dbprov hosts and decommission the old ones
Closed, ResolvedPublic
Actions

Description

Setup

  • dbprov1005
  • dbprov1006
  • dbprov2005
  • dbprov2006

Decom (from a service owner point of view)

  • dbprov1001
  • dbprov1002
  • dbprov2001
  • dbprov2002

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
dbbackups: Remove dbprov1001,1002,2001,2002 for decommissionJcrespooperations/puppetproduction+0 -13
dbbackups: Review and update grants for m1 dump user on codfwJcrespooperations/puppetproduction+24 -25
dbbackups: Set dbprov[12]00[12] to insetupJcrespooperations/puppetproduction+5 -45
dbbackups: Drain dbprov1001, dbprov1002, dbprov2001 & dbprov2002Jcrespooperations/puppetproduction+22 -21
dbbackups: Change correct port for s1 backupsJcrespooperations/puppetproduction+2 -2
dbbackups: Migrate s1 backups to MariaDB 10.6Jcrespooperations/puppetproduction+13 -10
dbbackups: Add stats grants for dbprov1006, dbprov2006 at m1:dbbackupsJcrespooperations/puppetproduction+6 -0
mariadb: Upgrade db1150, db1171 and move s4, s7, s8 backups to 10.6Jcrespooperations/puppetproduction+25 -34
dbbackups: Setup dbprov1006 & dbprov2006 and do s4 & s7 dumps thereJcrespooperations/puppetproduction+36 -2
dbbackups: Add dbprov1005 to the hosts that can dump eqiad backup sourcesJcrespooperations/puppetproduction+4 -0
dbbackups: Add ddbackups database grant access for dbprov1005Jcrespooperations/puppetproduction+3 -0
dbbackups: Setup dbprov1005 as new host to send s3 and s5 backupsJcrespooperations/puppetproduction+30 -19
installserver: Setup db and dbprov hosts back to reuse recipeJcrespooperations/puppetproduction+2 -2
mariadb: Add dbprov2005 to the grants for s*, x* hostsJcrespooperations/puppetproduction+4 -0
dbbackups: Add dbprov2005 to the list of hosts that can backup m1Jcrespooperations/puppetproduction+14 -45
mariadb: Add dbprov2005 to the list of hosts with dbbackups db accessJcrespooperations/puppetproduction+3 -0
dbbackups: Migrate s5 codfw snapshots to dbprov2005/db2201Jcrespooperations/puppetproduction+2 -2
dbprov: Setup dbprov2005Jcrespooperations/puppetproduction+19 -3
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

jcrespo created this task.Apr 15 2024, 8:03 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 15 2024, 8:03 AM
gerritbot added a comment.Apr 15 2024, 8:12 AM

Change #1019673 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbprov: Setup dbprov2005

https://gerrit.wikimedia.org/r/1019673

gerritbot added a project: Patch-For-Review.Apr 15 2024, 8:12 AM
gerritbot added a comment.Apr 15 2024, 8:44 AM

Change #1019673 merged by Jcrespo:

[operations/puppet@production] dbprov: Setup dbprov2005

https://gerrit.wikimedia.org/r/1019673

gerritbot added a comment.Apr 15 2024, 8:49 AM

Change #1019679 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Migrate s5 codfw snapshots to dbprov2005/db2201

https://gerrit.wikimedia.org/r/1019679

gerritbot added a comment.Apr 15 2024, 9:02 AM

Change #1019679 merged by Jcrespo:

[operations/puppet@production] dbbackups: Migrate s5 codfw snapshots to dbprov2005/db2201

https://gerrit.wikimedia.org/r/1019679

gerritbot added a comment.Apr 15 2024, 11:58 AM

Change #1019733 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] mariadb: Add dbprov2005 to the list of hosts that can access dbbackups db

https://gerrit.wikimedia.org/r/1019733

gerritbot added a comment.Apr 15 2024, 12:01 PM

Change #1019735 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add dbprov2005 to the list of hosts that can backup m1

https://gerrit.wikimedia.org/r/1019735

gerritbot added a comment.Apr 15 2024, 12:03 PM

Change #1019733 merged by Jcrespo:

[operations/puppet@production] mariadb: Add dbprov2005 to the list of hosts with dbbackups db access

https://gerrit.wikimedia.org/r/1019733

Stashbot added a comment.Apr 15 2024, 1:59 PM

Mentioned in SAL (#wikimedia-operations) [2024-04-15T13:59:29Z] <jynus> update dbprov2005 dbbackups password T362509

gerritbot added a comment.Apr 15 2024, 2:11 PM

Change #1019815 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] mariadb: Add dbprov2005 to the grants for s*, x* hosts

https://gerrit.wikimedia.org/r/1019815

gerritbot added a comment.Apr 15 2024, 2:11 PM

Change #1019816 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] installserver: Setup db and dbprov hosts back to reuse recipe

https://gerrit.wikimedia.org/r/1019816

gerritbot added a comment.Apr 16 2024, 2:10 PM

Change #1019816 merged by Jcrespo:

[operations/puppet@production] installserver: Setup db and dbprov hosts back to reuse recipe

https://gerrit.wikimedia.org/r/1019816

gerritbot added a comment.Apr 17 2024, 9:19 AM

Change #1020750 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Setup dbprov1005 as new host to send s3 and s5 backups

https://gerrit.wikimedia.org/r/1020750

gerritbot added a comment.Apr 18 2024, 7:50 AM

Change #1020750 merged by Jcrespo:

[operations/puppet@production] dbbackups: Setup dbprov1005 as new host to send s3 and s5 backups

https://gerrit.wikimedia.org/r/1020750

jcrespo updated the task description. (Show Details)Apr 18 2024, 9:08 AM
gerritbot added a comment.Apr 18 2024, 1:15 PM

Change #1021469 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add dbprov1005 to adding access ddbackups database

https://gerrit.wikimedia.org/r/1021469

gerritbot added a comment.Apr 18 2024, 1:42 PM

Change #1021469 merged by Jcrespo:

[operations/puppet@production] dbbackups: Add ddbackups database grant access for dbprov1005

https://gerrit.wikimedia.org/r/1021469

Stashbot added a comment.Apr 18 2024, 1:47 PM

Mentioned in SAL (#wikimedia-operations) [2024-04-18T13:47:43Z] <jynus> add grants for dbprov1005 at dbbackups (m1) T362509

gerritbot added a comment.Apr 19 2024, 11:56 AM

Change #1021903 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add dbprov1005 to the hosts that can dump eqiad backup sources

https://gerrit.wikimedia.org/r/1021903

gerritbot added a comment.Apr 23 2024, 11:23 AM

Change #1021903 merged by Jcrespo:

[operations/puppet@production] dbbackups: Add dbprov1005 to the hosts that can dump eqiad backup sources

https://gerrit.wikimedia.org/r/1021903

gerritbot added a comment.Apr 30 2024, 9:24 AM

Change #1025695 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Setup dbprov1006 & dbprov2006 and do s4 & s7 dumps there

https://gerrit.wikimedia.org/r/1025695

gerritbot added a comment.Apr 30 2024, 9:54 AM

Change #1025695 merged by Jcrespo:

[operations/puppet@production] dbbackups: Setup dbprov1006 & dbprov2006 and do s4 & s7 dumps there

https://gerrit.wikimedia.org/r/1025695

gerritbot added a comment.Apr 30 2024, 10:18 AM

Change #1025710 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] mariadb: Upgrade db1150, db1171 and move s4, s7, s8 backups to 10.6

https://gerrit.wikimedia.org/r/1025710

jcrespo updated the task description. (Show Details)Apr 30 2024, 10:22 AM
gerritbot added a comment.May 9 2024, 9:40 AM

Change #1025710 merged by Jcrespo:

[operations/puppet@production] mariadb: Upgrade db1150, db1171 and move s4, s7, s8 backups to 10.6

https://gerrit.wikimedia.org/r/1025710

jcrespo triaged this task as High priority.May 9 2024, 9:58 AM
gerritbot added a comment.May 13 2024, 8:58 AM

Change #1030896 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Add stats grants for dbprov1006, dbprov2006 at m1:dbbackups

https://gerrit.wikimedia.org/r/1030896

gerritbot added a comment.May 13 2024, 9:03 AM

Change #1030896 merged by Jcrespo:

[operations/puppet@production] dbbackups: Add stats grants for dbprov1006, dbprov2006 at m1:dbbackups

https://gerrit.wikimedia.org/r/1030896

Stashbot added a comment.May 13 2024, 9:05 AM

Mentioned in SAL (#wikimedia-operations) [2024-05-13T09:05:57Z] <jynus> deploy new stat grants at m1:dbbackups T362509

gerritbot added a comment.May 29 2024, 3:46 PM

Change #1037107 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Migrate s1 backups to MariaDB 10.6

https://gerrit.wikimedia.org/r/1037107

gerritbot added a comment.May 29 2024, 4:18 PM

Change #1037107 merged by Jcrespo:

[operations/puppet@production] dbbackups: Migrate s1 backups to MariaDB 10.6

https://gerrit.wikimedia.org/r/1037107

gerritbot added a comment.Jun 4 2024, 8:24 AM

Change #1038693 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Change correct port for s1 backups

https://gerrit.wikimedia.org/r/1038693

gerritbot added a comment.Jun 4 2024, 8:56 AM

Change #1038693 merged by Jcrespo:

[operations/puppet@production] dbbackups: Change correct port for s1 backups

https://gerrit.wikimedia.org/r/1038693

gerritbot added a comment.Jun 6 2024, 12:43 PM

Change #1039713 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Drain dbprov1001, dbprov1002, dbprov2001 & dbprov2002

https://gerrit.wikimedia.org/r/1039713

gerritbot added a comment.Jun 6 2024, 1:18 PM

Change #1039713 merged by Jcrespo:

[operations/puppet@production] dbbackups: Drain dbprov1001, dbprov1002, dbprov2001 & dbprov2002

https://gerrit.wikimedia.org/r/1039713

gerritbot added a comment.Jul 3 2024, 11:42 AM

Change #1051735 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Set dbprov[12]00[12] to insetup

https://gerrit.wikimedia.org/r/1051735

jcrespo added subscribers: ABran-WMF, Volans.Jul 3 2024, 11:48 AM

@Volans @ABran-WMF FYI

jcrespo added a comment.EditedJul 3 2024, 11:49 AM

Let's wait a little bit before deleting the files on the old dbprovs just in case (I will do it when I come back).

ABran-WMF added a comment.Jul 3 2024, 12:04 PM

noted, thanks @jcrespo !

jcrespo changed the task status from Open to Stalled.Jul 3 2024, 12:35 PM
jcrespo removed jcrespo as the assignee of this task.
gerritbot added a comment.Jul 3 2024, 3:14 PM

Change #1051735 merged by Jcrespo:

[operations/puppet@production] dbbackups: Set dbprov[12]00[12] to insetup

https://gerrit.wikimedia.org/r/1051735

jcrespo changed the task status from Stalled to In Progress.Oct 10 2024, 3:49 PM
jcrespo claimed this task.
jcrespo moved this task from Triage to In Progress on the Data-Persistence-Backup board.
jcrespo added a parent task: T376921: Upgrade dbprov hosts to Debian Bookworm.Oct 10 2024, 6:12 PM
jcrespo removed jcrespo as the assignee of this task.Nov 25 2024, 11:37 AM
gerritbot added a comment.Jan 14 2025, 10:20 AM

Change #1111182 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Review and update grants for m1 dump user on codfw

https://gerrit.wikimedia.org/r/1111182

gerritbot added a comment.Jan 14 2025, 5:29 PM

Change #1111182 merged by Jcrespo:

[operations/puppet@production] dbbackups: Review and update grants for m1 dump user on codfw

https://gerrit.wikimedia.org/r/1111182

gerritbot added a comment.Jan 16 2025, 11:26 AM

Change #1111946 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Remove dbprov1001,1002,2001,2002 for decommission

https://gerrit.wikimedia.org/r/1111946

jcrespo claimed this task.Jan 16 2025, 12:01 PM
jcrespo added a subtask: T383871: decommission dbprov1001, dbprov1002.
gerritbot added a comment.Jan 16 2025, 12:07 PM

Change #1111946 merged by Jcrespo:

[operations/puppet@production] dbbackups: Remove dbprov1001,1002,2001,2002 for decommission

https://gerrit.wikimedia.org/r/1111946

jcrespo updated the task description. (Show Details)Jan 16 2025, 12:27 PM
jcrespo closed this task as Resolved.Jan 16 2025, 2:24 PM
jcrespo updated the task description. (Show Details)

Finally done.

jcrespo added a subtask: T383894: decommission dbprov2001, dbprov2002.Jan 16 2025, 3:08 PM
Jhancock.wm closed subtask T383894: decommission dbprov2001, dbprov2002 as Resolved.Jan 22 2025, 5:30 PM
Papaul closed subtask T383871: decommission dbprov1001, dbprov1002 as Resolved.Jan 27 2025, 5:27 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits