Decommission an-tool1010
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Gehel
	Dec 20 2023, 10:37 AM

Description

This can be done once Superset has migrated to k8s

Details

	Subject	Repo	Branch	Lines +/-
	Decommission an-tool1010.eqiad.wmnet	operations/puppet	production	+0 -7

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	brouberol	T353782 Decommission an-tool1010
Resolved	brouberol	T347710 Migrate the Analytics Superset instances to our DSE Kubernetes cluster
Resolved	BTullis	T349396 Write a design document relating to superset on dse-k8s
Resolved	BTullis	T352165 Create a superset container image using the PipelineLib framework
Resolved	brouberol	T352166 Create a helm chart for Superset
Resolved	brouberol	T353790 Create helmfile deployment files for superset and superset-next
Resolved	brouberol	T353794 Configure OIDC Authentication for Superset on K8S
Resolved	brouberol	T297120 Assign users' real names and email addresses to their Superset user accounts automatically
		Restricted Task
Resolved	brouberol	T356477 Apply our patches not yet merged upstream to the supserset codebase in our Docker image
Resolved	brouberol	T356480 Make configuration secrets available to helmfile
Resolved	brouberol	T356481 Configure ingress internal DNS records
Resolved	brouberol	T356482 [superset k8s] Update public domain DNS records to make them point to the DSE Kubernetes ingress
Resolved	brouberol	T356483 [superset k8s] Add entries to the puppet service catalog
Resolved	Stevemunene	T356484 Monitor the availability of the superset deployments
Resolved	Stevemunene	T356485 Create saved views for the superset deployment logs
Resolved	Stevemunene	T356486 [superset k8s] Update the wikitech page with our production readiness checklist
Resolved	brouberol	T356490 [superset-k8s] Find a solution for the requestctl-generator html page
Resolved	brouberol	T356623 Ensure necessary firewall rules are open between the DSE worker nodes and external services
Resolved	BTullis	T357890 Serve Superset static assets from an optimised container
Resolved	brouberol	T358479 Declare the superset domains as alternate domains
Resolved	brouberol	T358480 Remove all resources associated with the superset-(next-)k8s.wimedia.org domains
Resolved	brouberol	T358510 Filter out DEBUG kerberos logs from the container output
Resolved	brouberol	T358569 Migrate bare-metal superset services over to Kubernetes
Resolved	brouberol	T358570 Cleanup superset related resources from puppet
Resolved	BTullis	T358650 Create superset-admins LDAP group and populate with the current list of Admins from the production instance.
Resolved	brouberol	T358706 Decommission an-tool1005
Declined	brouberol	T358753 Re-evaluate data cache security issues, along with per user data caching
Resolved	brouberol	T358778 Monitor the Superset Kubernetes application
Declined	None	T294772 Superset Timeout Logging

Event Timeline

Gehel created this task.Dec 20 2023, 10:37 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 20 2023, 10:37 AM

Gehel triaged this task as High priority.Dec 20 2023, 10:38 AM

Gehel added a subtask: T347710: Migrate the Analytics Superset instances to our DSE Kubernetes cluster.

Gehel moved this task from Incoming to Hardware refresh on the Data-Platform-SRE board.

BTullis removed a subtask: T358706: Decommission an-tool1005.Feb 28 2024, 6:42 PM

Moving this into our current milestone, now that superset has been fully migrated to Kubernetes.

Change #1014432 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/puppet@production] Decommission an-tool1010.eqiad.wmnet

https://gerrit.wikimedia.org/r/1014432

gerritbot added a project: Patch-For-Review.Mar 26 2024, 9:10 AM

brouberol claimed this task.Mar 26 2024, 9:13 AM

cookbooks.sre.hosts.decommission executed by brouberol@cumin1002 for hosts: an-tool1010.eqiad.wmnet

an-tool1010.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found physical host
- Downtimed management interface on Alertmanager
- Wiped all swraid, partition-table and filesystem signatures
- Powered off
- [Netbox] Set status to Decommissioning, deleted all non-mgmt IPs, updated switch interfaces (disabled, removed vlans, etc)
- Configured the linked switch interface(s)
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB