Change 844488 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] admin: Add mw-debug namespace

https://gerrit.wikimedia.org/r/844488

Change 844491 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] hieradata: Add usernames for mw-debug k8s service

https://gerrit.wikimedia.org/r/844491

Change 844491 merged by Clément Goubert:

[operations/puppet@production] hieradata: Add usernames for mw-debug k8s service

https://gerrit.wikimedia.org/r/844491

Change 844488 merged by jenkins-bot:

[operations/deployment-charts@master] admin: Add mw-debug namespace

https://gerrit.wikimedia.org/r/844488

Change 849501 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] mediawiki: Create new mw-debug deployment

https://gerrit.wikimedia.org/r/849501

Change 849502 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] kubernetes: Rename mwdebug to mw-debug

https://gerrit.wikimedia.org/r/849502

• check deployment window
• pause the deployment script on deploy1002: sudo touch /var/lib/deploy-mwdebug/pause
• cd /etc/helmfile-defaults/mediawiki/release/; git mv mwdebug-pinkunicorn.yaml mw-debug-pinkunicorn.yaml; git commit -am "Rename mwdebug to mw-debug"
• silence alert=ProbeDown and instance="mwdebug:4444"
• delete mwdebug deployment
• apply mw-debug deployment
• merge and deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/849502/2
• remove the pause: sudo rm /var/lib/deploy-mwdebug/pause
• run the script: sudo -u mwbuilder /usr/local/sbin/deploy-mwdebug
• remove silence

Change 849501 merged by jenkins-bot:

[operations/deployment-charts@master] mediawiki: Create new mw-debug deployment

https://gerrit.wikimedia.org/r/849501

Change 849502 merged by Clément Goubert:

[operations/puppet@production] kubernetes: Rename mwdebug to mw-debug

https://gerrit.wikimedia.org/r/849502

Change 850184 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] mw-debug: Remove old mwdebug deployment

https://gerrit.wikimedia.org/r/850184

Switch done, only cleanup in deployment-charts left.

Change 852186 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/deployment-charts@master] admin: Remove stale mwdebug stanzas

https://gerrit.wikimedia.org/r/852186

Change 852777 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] mwdebug: absent kubernetes service

https://gerrit.wikimedia.org/r/852777

Change 852809 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[labs/private@master] mw-debug: Add dummy service data

https://gerrit.wikimedia.org/r/852809

Change 852811 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[labs/private@master] mwdebug: Remove dummy service data

https://gerrit.wikimedia.org/r/852811

In order to cleanup :

1. Remove mwdebug private puppet resources in profile::kubernetes::infrastructure_user and profile::kubernetes::deployment_server_secrets::services https://gerrit.wikimedia.org/r/c/labs/private/+/852811
2. Remove mwdebug stanzas from admin_ng https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/852186 then cleanup the admin_ng namespace (helmfile apply on the same model as https://wikitech.wikimedia.org/wiki/Kubernetes/Add_a_new_service#Deploy_changes_to_helmfile.d/admin_ng)
3. Remove mwdebug deployment definition https://gerrit.wikimedia.org/r/850184
4. Remove mwdebug puppet resources https://gerrit.wikimedia.org/r/c/operations/puppet/+/852777

@JMeybohm @Joe @akosiaris If this seems like the right way, I will start writing the "Kubernetes/Remove_a_service" wikitech doc.

Change 850184 merged by jenkins-bot:

[operations/deployment-charts@master] mwdebug: Remove old mwdebug deployment

https://gerrit.wikimedia.org/r/850184

Change 852186 merged by jenkins-bot:

[operations/deployment-charts@master] admin: Remove stale mwdebug stanzas

https://gerrit.wikimedia.org/r/852186

Change 852777 merged by Clément Goubert:

[operations/puppet@production] mwdebug: absent kubernetes service

https://gerrit.wikimedia.org/r/852777

Removing the private resources first seem to stop the correct cleanup of the puppet resources. For mwdebug, only the helmfile for staging got removed, it no-ops on codfw and eqiad environments. Digging.

Change 852809 merged by Clément Goubert:

[labs/private@master] mw-debug: Add dummy service data

https://gerrit.wikimedia.org/r/852809

Change 852811 merged by Clément Goubert:

[labs/private@master] mwdebug: Remove dummy service data

https://gerrit.wikimedia.org/r/852811

In T321201#8366250, @Clement_Goubert wrote:

[...]
@JMeybohm @Joe @akosiaris If this seems like the right way, I will start writing the "Kubernetes/Remove_a_service" wikitech doc.

Late to the party (sorry). But FWIW this looks good to me. Thanks for writing docs!

Change 854559 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] mwdebug: Final cleanup

https://gerrit.wikimedia.org/r/854559

I lied.

Change 854559 merged by Clément Goubert:

[operations/puppet@production] mwdebug: Final cleanup

https://gerrit.wikimedia.org/r/854559