Page MenuHomePhabricator
Create Task
Maniphest T397498

Deprecate mwdebugXXXX hosts
Closed, ResolvedPublic
Actions

Description

After completing T276994, we can let go of all mwdebugXXXX, and thank them for their service.

  • remove from debug.json (XWD)
  • remove from trafficserver
  • retire all VMs
  • remove from conftool
  • remove from dsh (scap)

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

jijiki created this task.Jun 20 2025, 7:20 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 20 2025, 7:20 AM
jijiki added a subtask: T276994: Provide an mwdebug functionality on kubernetes (mw-experimental).Jun 20 2025, 7:20 AM
jijiki added projects: MediaWiki-Engineering, Release-Engineering-Team.
jijiki added subscribers: Lucas_Werkmeister_WMDE, Krinkle.
Aklapper renamed this task from Depricate mwdebugXXXX hosts to Deprecate mwdebugXXXX hosts.Jun 20 2025, 8:08 AM
jijiki changed the task status from Open to In Progress.Jun 25 2025, 3:09 PM
jijiki triaged this task as Medium priority.
jijiki updated the task description. (Show Details)Jun 26 2025, 10:47 AM
gerritbot added a comment.Jun 26 2025, 10:48 AM

Change #1164148 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/mediawiki-config@master] debug.json: remove mwdebugX hosts

https://gerrit.wikimedia.org/r/1164148

gerritbot added a project: Patch-For-Review.Jun 26 2025, 10:48 AM
jijiki updated the task description. (Show Details)Jun 26 2025, 11:14 AM
jijiki updated the task description. (Show Details)Jun 26 2025, 11:25 AM
jijiki closed subtask T276994: Provide an mwdebug functionality on kubernetes (mw-experimental) as Resolved.Jun 26 2025, 11:32 AM
gerritbot added a comment.Jun 26 2025, 1:24 PM

Change #1164148 merged by jenkins-bot:

[operations/mediawiki-config@master] debug.json: remove mwdebugX hosts

https://gerrit.wikimedia.org/r/1164148

Stashbot mentioned this in T397913: Disable translations in Serbo-Croatian Latin and Cyrillic scripts ($wgTranslateDisabledTargetLanguages).Jun 26 2025, 1:25 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-26T13:25:10Z] <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:rOPUP116414528246|[arwikiversity] fix wordmark (T397845)]], [[gerrit:1164148|debug.json: remove mwdebugX hosts (T397498)]], [[gerrit:1164146|Disable translations in sh-latn and sh-cyrl (wgTranslateDisabledTargetLanguages) (T397913)]]

Stashbot mentioned this in T397845: Fix Arabic wikiversity wordmark.Jun 26 2025, 1:25 PM
Stashbot added a comment.Jun 26 2025, 1:27 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-26T13:27:26Z] <lucaswerkmeister-wmde@deploy1003> jiji, aleksandar, gergesshamon, lucaswerkmeister-wmde: Backport for [[gerrit:rOPUP116414528246|[arwikiversity] fix wordmark (T397845)]], [[gerrit:1164148|debug.json: remove mwdebugX hosts (T397498)]], [[gerrit:1164146|Disable translations in sh-latn and sh-cyrl (wgTranslateDisabledTargetLanguages) (T397913)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes c

Maintenance_bot removed a project: Patch-For-Review.Jun 26 2025, 1:32 PM
gerritbot added a comment.Jun 26 2025, 1:38 PM

Change #1164207 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] trafficserver: remove mwdebugX XWD entries

https://gerrit.wikimedia.org/r/1164207

gerritbot added a project: Patch-For-Review.Jun 26 2025, 1:38 PM
Stashbot added a comment.Jun 26 2025, 1:44 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-26T13:44:12Z] <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:rOPUP116414528246|[arwikiversity] fix wordmark (T397845)]], [[gerrit:1164148|debug.json: remove mwdebugX hosts (T397498)]], [[gerrit:1164146|Disable translations in sh-latn and sh-cyrl (wgTranslateDisabledTargetLanguages) (T397913)]] (duration: 19m 02s)

gerritbot added a comment.Jul 1 2025, 11:56 AM

Change #1165492 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] dsh: remove testservers from scap destinations

https://gerrit.wikimedia.org/r/1165492

jijiki updated the task description. (Show Details)Jul 1 2025, 11:56 AM
MSantos moved this task from Inbox, needs triage to Radar on the MediaWiki-Engineering board.Jul 2 2025, 12:58 PM
gerritbot added a comment.Jul 14 2025, 10:42 AM

Change #1164207 merged by Effie Mouzeli:

[operations/puppet@production] trafficserver: remove mwdebugX XWD entries

https://gerrit.wikimedia.org/r/1164207

gerritbot added a comment.Jul 14 2025, 11:31 AM

Change #1169091 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] DNM: Remove testserver from conftool and scap

https://gerrit.wikimedia.org/r/1169091

gerritbot added a comment.Jul 16 2025, 11:26 AM

Change #1165492 abandoned by Effie Mouzeli:

[operations/puppet@production] dsh: remove testservers from scap destinations

Reason:

resubmitted in I962d8cd942a15abecb5cd76040fb163be8e38eb8

https://gerrit.wikimedia.org/r/1165492

gerritbot added a comment.Jul 16 2025, 11:26 AM

Change #1169673 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] dsh: remove testservers from scap destinations

https://gerrit.wikimedia.org/r/1169673

thcipriani edited projects, added Release-Engineering-Team (Radar); removed Release-Engineering-Team.Jul 23 2025, 3:56 PM
gerritbot added a comment.Jul 29 2025, 7:37 AM

Change #1173871 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] etcd::tlsproxy: Remove testserver ACLs 2

https://gerrit.wikimedia.org/r/1173871

gerritbot added a comment.Jul 29 2025, 7:50 AM

Change #1173877 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] conftool-data: remove testservers

https://gerrit.wikimedia.org/r/1173877

gerritbot added a comment.Aug 4 2025, 2:32 PM

Change #1169673 merged by Effie Mouzeli:

[operations/puppet@production] dsh: remove testservers from scap destinations 1

https://gerrit.wikimedia.org/r/1169673

Scott_French mentioned this in T368096: mediawiki: migrate from image-suggestion to data-gateway.Aug 21 2025, 7:38 PM
Scott_French updated the task description. (Show Details)
Scott_French subscribed.Sep 5 2025, 10:02 PM
jasmine_ subscribed.Sep 5 2025, 10:11 PM
Krinkle mentioned this in T405688: Support shell to mw-experimental pod.Sep 25 2025, 11:42 PM
gerritbot added a comment.Oct 22 2025, 10:38 AM

Change #1198019 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] scap: remove testservers 4

https://gerrit.wikimedia.org/r/1198019

gerritbot added a comment.Oct 22 2025, 11:00 AM

Change #1173871 merged by Effie Mouzeli:

[operations/puppet@production] etcd::tlsproxy: Remove testserver ACLs 2

https://gerrit.wikimedia.org/r/1173871

gerritbot added a comment.Oct 22 2025, 11:01 AM

Change #1173877 merged by Effie Mouzeli:

[operations/puppet@production] conftool-data: remove testservers 3

https://gerrit.wikimedia.org/r/1173877

gerritbot added a comment.Oct 22 2025, 12:15 PM

Change #1198035 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] site.pp: bye bye mwdebugXXXX 5

https://gerrit.wikimedia.org/r/1198035

gerritbot added a comment.Oct 23 2025, 8:29 AM

Change #1198035 merged by Effie Mouzeli:

[operations/puppet@production] site.pp: bye bye mwdebugXXXX 5

https://gerrit.wikimedia.org/r/1198035

gerritbot added a comment.Oct 31 2025, 11:46 AM

Change #1200331 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] api-gateway: removed mwdebug* hosts from networkpolicy

https://gerrit.wikimedia.org/r/1200331

ops-monitoring-bot added a comment.Oct 31 2025, 11:46 AM

cookbooks.sre.hosts.decommission executed by jiji@cumin1003 for hosts: mwdebug[1001-1002].eqiad.wmnet

  • mwdebug1001.eqiad.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster eqiad to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster eqiad to Netbox
  • mwdebug1002.eqiad.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster eqiad to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster eqiad to Netbox
gerritbot added a comment.Oct 31 2025, 11:54 AM

Change #1200332 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] site.pp: remove decommed mwdebug hosts

https://gerrit.wikimedia.org/r/1200332

ops-monitoring-bot added a comment.Oct 31 2025, 12:17 PM

cookbooks.sre.hosts.decommission executed by jiji@cumin1003 for hosts: mwdebug[2001-2002].codfw.wmnet

  • mwdebug2001.codfw.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster codfw to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster codfw to Netbox
  • mwdebug2002.codfw.wmnet (PASS)
    • Downtimed host on Icinga/Alertmanager
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster codfw to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster codfw to Netbox
gerritbot added a comment.Nov 4 2025, 11:52 AM

Change #1200332 merged by Effie Mouzeli:

[operations/puppet@production] site.pp: remove decommed mwdebug hosts

https://gerrit.wikimedia.org/r/1200332

jijiki closed this task as Resolved.Nov 4 2025, 12:44 PM
jijiki claimed this task.
jijiki updated the task description. (Show Details)
gerritbot added a comment.Nov 4 2025, 12:46 PM

Change #1200331 merged by jenkins-bot:

[operations/deployment-charts@master] api-gateway: remove mwdebug* hosts from networkpolicy

https://gerrit.wikimedia.org/r/1200331

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits