Page MenuHomePhabricator

Delete lists-next.wikimedia.org
Closed, ResolvedPublic

Description

lists-next.wikimedia.org was a test install of Mailman3 which allowed us to test the full integration with the production environment as well as the migration process with real data (that contained PII).

We need to clean up/delete:

  • The VM
  • Databases
  • DNS/IPs

Setting to stalled until we're ready to do this.

Event Timeline

Legoktm changed the task status from Open to Stalled.Apr 30 2021, 1:13 AM
Legoktm created this task.

We should rename it to lists-current.wikimedia.org ;)

Adding @Marostegui for visibility.

Dzahn triaged this task as Low priority.May 3 2021, 7:04 PM
Legoktm changed the task status from Stalled to Open.May 8 2021, 7:09 AM

We can do this next week.

Sounds good, ping me whenever you want to get the databases deleted.
Is it needed to take a final backup from these testing databases?
I am off Thursday and Friday, but @Kormat can help you out here deleting the databases and the grants if needed.

Actually, @Kormat is out as well so it'll have to either happen by Wednesday or next week.

We don't need a backup, it's all just emails of people saying "Test" etc. :P, I'll delete the VM tomorrow (Pacific Time) so it should be ready for DBA deletion on Wednesday :)

Sure, that works. Just let me know when we can proceed.
I assume we'd need to delete the following databases:

testmailman3
testmailman3web

And the following users:

| testmailman3    | 208.80.154.13 |
| testmailman3web | 208.80.154.13 |

Can you confirm that?
Thanks

Change 688975 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] production-m5.sql: Remove testmailman users

https://gerrit.wikimedia.org/r/688975

Ready to merge this whenver you review it: https://gerrit.wikimedia.org/r/688975
Once merge this requires removing the users manually too in the DB.

Change 689313 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] decom lists1002/lists-next

https://gerrit.wikimedia.org/r/689313

cookbooks.sre.hosts.decommission executed by legoktm@cumin1001 for hosts: lists1002.wikimedia.org

  • lists1002.wikimedia.org (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.eqiad.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.eqiad.wmnet to Netbox
  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook: Cumin execution failed (exit_code=2)

ERROR: some step on some host failed, check the bolded items above

Change 689315 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/dns@master] Remove lists-next

https://gerrit.wikimedia.org/r/689315

Change 689315 merged by Legoktm:

[operations/dns@master] Remove lists-next

https://gerrit.wikimedia.org/r/689315

  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook: Cumin execution failed (exit_code=2)

I manually ran authdns-update after updating the ops/dns repo.

Change 689327 had a related patch set uploaded (by Legoktm; author: Legoktm):

[labs/private@master] Remove lists1002/lists-next

https://gerrit.wikimedia.org/r/689327

Change 689327 merged by Legoktm:

[labs/private@master] Remove lists1002/lists-next

https://gerrit.wikimedia.org/r/689327

I deleted the VM, DNS, private puppet, labs/private.

@Marostegui all ready for you to do database deletion!

Change 688975 merged by Marostegui:

[operations/puppet@production] production-m5.sql: Remove testmailman users

https://gerrit.wikimedia.org/r/688975

Mentioned in SAL (#wikimedia-operations) [2021-05-12T04:38:58Z] <marostegui> Drop testing mailman3 databases T281548

Databases and users dropped. The DB side of things complete.

Legoktm claimed this task.

All done then!

Change 689313 merged by Legoktm:

[operations/puppet@production] decom lists1002/lists-next

https://gerrit.wikimedia.org/r/689313