Maniphest T333697

decom an-airflow1001
Closed, ResolvedPublic2 Estimated Story Points
Actions

Assigned To

Authored By

	EBernhardson
	Mar 31 2023, 3:11 PM

Tags

Referenced Files

None

Subscribers

Description

All airflow dags have been disabled on this instance, the remaining step is to decom it. Decom includes:

Remove instance from ganetti
Drop search_airflow database from an-coord1001 mysql instance
Remove all airflow 1 puppet code

Details

	Subject	Repo	Branch	Lines +/-
	Update the cumin alias for analytics-airflow	operations/puppet	production	+1 -1
	Replace an-airflow1001 with an-airflow1005 in refinery thin deploys	analytics/refinery/scap	master	+1 -1
	airflow: decommission an-airflow1001	operations/puppet	production	+1 -6

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Gehel	T322905 [EPIC] Upgrade Search Platform spark jobs to spark 3
		Resolved		Gehel	T318414 [Tracking] Migrate Search Airflow jobs to Airflow 2 and use shared supporting code from the data engineering Airflow
		Resolved		BTullis	T333697 decom an-airflow1001

Event Timeline

EBernhardson created this task.Mar 31 2023, 3:11 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 31 2023, 3:11 PM

Gehel moved this task from needs triage to Current work on the Discovery-Search board.Apr 3 2023, 3:54 PM

Gehel edited projects, added Discovery-Search (Current work); removed Discovery-Search.

Gehel added a parent task: T318414: [Tracking] Migrate Search Airflow jobs to Airflow 2 and use shared supporting code from the data engineering Airflow.

MPhamWMF set the point value for this task to 2.May 1 2023, 3:47 PM

MPhamWMF moved this task from Incoming to Ready for Dev -- SRE/Ops on the Discovery-Search (Current work) board.

bking subscribed.May 8 2023, 1:29 PM

Change 917343 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] airflow: decommission an-airflow1001

https://gerrit.wikimedia.org/r/917343

gerritbot added a project: Patch-For-Review.May 8 2023, 2:14 PM

cookbooks.sre.hosts.decommission executed by bking@cumin1001 for hosts: an-airflow1001.eqiad.wmnet

an-airflow1001.eqiad.wmnet (PASS)
- Downtimed host on Icinga/Alertmanager
- Found Ganeti VM
- VM shutdown
- Started forced sync of VMs in Ganeti cluster eqiad to Netbox
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB
- VM removed
- Started forced sync of VMs in Ganeti cluster eqiad to Netbox

Change 917343 merged by Bking:

[operations/puppet@production] airflow: decommission an-airflow1001

https://gerrit.wikimedia.org/r/917343

Maintenance_bot removed a project: Patch-For-Review.May 9 2023, 5:10 PM

Change 919036 had a related patch set uploaded (by Btullis; author: Btullis):

[analytics/refinery/scap@master] Remove an-airflow1001 from refinery thin deployment targets

https://gerrit.wikimedia.org/r/919036

gerritbot added a project: Patch-For-Review.May 11 2023, 11:18 AM

Change 919036 merged by Joal:

[analytics/refinery/scap@master] Replace an-airflow1001 with an-airflow1005 in refinery thin deploys

https://gerrit.wikimedia.org/r/919036

Maintenance_bot removed a project: Patch-For-Review.May 16 2023, 12:30 PM

Gehel added a project: Data-Platform-SRE.Jun 13 2023, 8:24 AM

Gehel moved this task from Incoming to Ready for Work on the Data-Platform-SRE board.

Change 929702 had a related patch set uploaded (by Btullis; author: Btullis):

[operations/puppet@production] Update the cumin alias for analytics-airflow

https://gerrit.wikimedia.org/r/929702

gerritbot added a project: Patch-For-Review.Jun 13 2023, 1:10 PM

Change 929702 merged by Btullis:

[operations/puppet@production] Update the cumin alias for analytics-airflow

https://gerrit.wikimedia.org/r/929702

Maintenance_bot removed a project: Patch-For-Review.Jul 17 2023, 8:30 AM

I think that this task is complete.