Page MenuHomePhabricator
Create Task
Maniphest T381962

Decommission dbproxy200[1-4]
Closed, ResolvedPublic
Actions

Description

Old proxies need to be decommissioned

  • dbproxy2001
  • dbproxy2002
  • dbproxy2003
  • dbproxy2004

Reminder: Remove their IP from the whitelist of report_users script.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
production-m5.sql.erb: Replace dbproxy2004 with dbproxy2008operations/puppetproduction+3 -3
report_users.sh: Remove dbproxy2004operations/softwaremaster+0 -1
production-m3.sql.erb: Replace dbproxy2003 with dbproxy2007operations/puppetproduction+6 -6
report_users.sh: Remove dbproxy2003operations/softwaremaster+0 -1
report_users.sh: Remove dbproxy2002operations/softwaremaster+0 -1
production-m2.sql.erb: Replace dbproxy2002 with dbproxy2006operations/puppetproduction+6 -6
site.pp: Update notes for codfw proxiesoperations/puppetproduction+2 -2
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedjcrespoT376916 Upgrade backup hosts to Debian Bookworm 12.X
 ResolvedjcrespoT383902 Upgrade backup source or mediabackup database host os to Debian bookworm or decommission them
Unknown Object (Task)
 ResolvedPapaulT362824 Q#:rack/setup/install dbproxy200[5-8]
Unknown Object (Task)
 Resolved• MarosteguiT373579 Productionize db22[21-40]
 Resolved• MarosteguiT374623 Decommission db21[21-40]
 Resolved• MarosteguiT368874 Productionize dbproxy102[89]
 ResolvedRequestJclark-ctrT383025 decommission dbproxy1020.eqiad.wmnet
 ResolvedRequestJclark-ctrT383033 decommission dbproxy1021.eqiad.wmnet
 Resolved• MarosteguiT367380 Productionize dbproxy200[5-8]
 Resolved• MarosteguiT381962 Decommission dbproxy200[1-4]
 ResolvedRequestJhancock.wmT382867 decommission dbproxy2001.codfw.wmnet
 ResolvedRequestJhancock.wmT382868 decommission dbproxy2002.codfw.wmnet
 ResolvedRequestJhancock.wmT382875 decommission dbproxy2003.codfw.wmnet
 ResolvedRequestJhancock.wmT382877 decommission dbproxy2004.codfw.wmnet
 ResolvedRequestJhancock.wmT383388 decommission db2123.codfw.wmnet
 ResolvedRequestJhancock.wmT383395 decommission db2126.codfw.wmnet
 ResolvedRequestJhancock.wmT383426 decommission db2135.codfw.wmnet
 ResolvedRequestJhancock.wmT383572 decommission db2128.codfw.wmnet
 ResolvedRequestJhancock.wmT383697 decommission db2132.codfw.wmnet
 ResolvedRequestJhancock.wmT383766 decommission db2130.codfw.wmnet
 ResolvedJhancock.wmT383971 decommission db2139
 ResolvedRequestJhancock.wmT384001 decommission db2131.codfw.wmnet
 ResolvedRequestJhancock.wmT384343 decommission db2133.codfw.wmnet
 ResolvedRequestJhancock.wmT384476 decommission db2134.codfw.wmnet
 ResolvedRequestJhancock.wmT384479 decommission db2136.codfw.wmnet
 ResolvedRequestJhancock.wmT384480 decommission db2140.codfw.wmnet

Event Timeline

• Marostegui created this task.Dec 11 2024, 10:57 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 11 2024, 10:57 AM
• Marostegui triaged this task as Medium priority.Dec 11 2024, 10:58 AM
• Marostegui moved this task from Triage to Blocked on the DBA board.

Let's give the new ones until the January to make sure they are working as expected.

gerritbot added a comment.Dec 12 2024, 2:02 PM

Change #1102852 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Update notes for codfw proxies

https://gerrit.wikimedia.org/r/1102852

gerritbot added a project: Patch-For-Review.Dec 12 2024, 2:02 PM

Change #1102852 merged by Marostegui:

[operations/puppet@production] site.pp: Update notes for codfw proxies

https://gerrit.wikimedia.org/r/1102852

Maintenance_bot removed a project: Patch-For-Review.Dec 12 2024, 2:31 PM
• Marostegui moved this task from Blocked to In progress on the DBA board.Jan 2 2025, 7:30 AM
• Marostegui added a subtask: T382867: decommission dbproxy2001.codfw.wmnet.Jan 2 2025, 7:35 AM
Stashbot added a comment.Jan 2 2025, 7:35 AM

Mentioned in SAL (#wikimedia-operations) [2025-01-02T07:35:11Z] <marostegui> Stop haproxy on dbproxy200[14] T381962

• Marostegui added a comment.Jan 2 2025, 7:36 AM

Stopped haproxy on all the hosts to see if something breaks

[07:35:42] marostegui@cumin1002:~$ sudo cumin 'dbproxy200[1-4]'.codfw.wmnet 'systemctl stop haproxy'
4 hosts will be targeted:
dbproxy[2001-2004].codfw.wmnet
OK to proceed on 4 hosts? Enter the number of affected hosts to confirm or "q" to quit: 4
===== NO OUTPUT =====
PASS |█████████████████████████████████████████████████████████████████████████████████████████| 100% (4/4) [00:01<00:00,  3.39hosts/s]
FAIL |                                                                                                 |   0% (0/4) [00:01<?, ?hosts/s]
100.0% (4/4) success ratio (>= 100.0% threshold) for command: 'systemctl stop haproxy'.
100.0% (4/4) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
• Marostegui updated the task description. (Show Details)Jan 2 2025, 8:09 AM
• Marostegui added a subtask: T382868: decommission dbproxy2002.codfw.wmnet.Jan 2 2025, 8:45 AM
gerritbot added a comment.Jan 2 2025, 8:46 AM

Change #1107922 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m2.sql.erb: Replace dbproxy2002 with dbproxy2006

https://gerrit.wikimedia.org/r/1107922

gerritbot added a project: Patch-For-Review.Jan 2 2025, 8:46 AM
gerritbot added a comment.Jan 2 2025, 8:48 AM

Change #1107922 merged by Marostegui:

[operations/puppet@production] production-m2.sql.erb: Replace dbproxy2002 with dbproxy2006

https://gerrit.wikimedia.org/r/1107922

gerritbot added a comment.Jan 2 2025, 8:50 AM

Change #1107923 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/software@master] report_users.sh: Remove dbproxy2002

https://gerrit.wikimedia.org/r/1107923

gerritbot added a comment.Jan 2 2025, 8:52 AM

Change #1107923 merged by jenkins-bot:

[operations/software@master] report_users.sh: Remove dbproxy2002

https://gerrit.wikimedia.org/r/1107923

• Marostegui updated the task description. (Show Details)Jan 2 2025, 9:03 AM
Maintenance_bot removed a project: Patch-For-Review.Jan 2 2025, 9:30 AM
• Marostegui added a subtask: T382875: decommission dbproxy2003.codfw.wmnet.Jan 2 2025, 9:58 AM
gerritbot added a comment.Jan 2 2025, 10:01 AM

Change #1107925 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/software@master] report_users.sh: Remove dbproxy2003

https://gerrit.wikimedia.org/r/1107925

gerritbot added a project: Patch-For-Review.Jan 2 2025, 10:01 AM

Change #1107926 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m3.sql.erb: Replace dbproxy2003 with dbproxy2007

https://gerrit.wikimedia.org/r/1107926

gerritbot added a comment.Jan 2 2025, 10:03 AM

Change #1107925 merged by jenkins-bot:

[operations/software@master] report_users.sh: Remove dbproxy2003

https://gerrit.wikimedia.org/r/1107925

gerritbot added a comment.Jan 2 2025, 10:05 AM

Change #1107926 merged by Marostegui:

[operations/puppet@production] production-m3.sql.erb: Replace dbproxy2003 with dbproxy2007

https://gerrit.wikimedia.org/r/1107926

• Marostegui updated the task description. (Show Details)Jan 2 2025, 10:16 AM
Maintenance_bot removed a project: Patch-For-Review.Jan 2 2025, 10:30 AM
• Marostegui added a subtask: T382877: decommission dbproxy2004.codfw.wmnet.Jan 2 2025, 10:40 AM
gerritbot added a comment.Jan 2 2025, 10:41 AM

Change #1107931 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/software@master] report_users.sh: Remove dbproxy2004

https://gerrit.wikimedia.org/r/1107931

gerritbot added a project: Patch-For-Review.Jan 2 2025, 10:41 AM

Change #1107930 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m5.sql.erb: Replace dbproxy2004 with dbproxy2008

https://gerrit.wikimedia.org/r/1107930

gerritbot added a comment.Jan 2 2025, 10:42 AM

Change #1107931 merged by jenkins-bot:

[operations/software@master] report_users.sh: Remove dbproxy2004

https://gerrit.wikimedia.org/r/1107931

gerritbot added a comment.Jan 2 2025, 10:47 AM

Change #1107930 merged by Marostegui:

[operations/puppet@production] production-m5.sql.erb: Replace dbproxy2004 with dbproxy2008

https://gerrit.wikimedia.org/r/1107930

Stashbot added a comment.Jan 2 2025, 10:56 AM

Mentioned in SAL (#wikimedia-operations) [2025-01-02T10:56:11Z] <marostegui> dbmaint codfw Decommissioned dbproxy200[1-4] T381962

Stashbot added a comment.Jan 2 2025, 10:56 AM

Mentioned in SAL (#wikimedia-operations) [2025-01-02T10:56:25Z] <marostegui> dbmaint codfw Decommissioned dbproxy200[1-4] m1 m2 m3 m5 T381962

• Marostegui updated the task description. (Show Details)Jan 2 2025, 10:57 AM

This is all done - all hosts have now decommission tasks which are just pending on-site steps.

• Marostegui closed this task as Resolved.Jan 2 2025, 10:58 AM
Maintenance_bot moved this task from In progress to Done on the DBA board.Jan 2 2025, 11:29 AM
Maintenance_bot removed a project: Patch-For-Review.
Jhancock.wm closed subtask T382877: decommission dbproxy2004.codfw.wmnet as Resolved.Jan 6 2025, 4:54 PM
Jhancock.wm closed subtask T382875: decommission dbproxy2003.codfw.wmnet as Resolved.Jan 6 2025, 5:09 PM
Jhancock.wm closed subtask T382867: decommission dbproxy2001.codfw.wmnet as Resolved.Jan 6 2025, 5:12 PM
Jhancock.wm closed subtask T382868: decommission dbproxy2002.codfw.wmnet as Resolved.Jan 6 2025, 5:16 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits