Page MenuHomePhabricator
Create Task
Maniphest T380615

Migrate the airflow-search database to Kubernetes
Closed, ResolvedPublic
Actions

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
airflow-research: disable the airflow systemd servicesoperations/puppetproduction+20 -20
dse-k8s-eqiad: prepare to migrate airflow-search instance to k8s, part 2operations/deployment-chartsmaster+4 -24
dse-k8s-eqiad: increase airflow-search pg instance disk sizeoperations/deployment-chartsmaster+2 -8
dse-k8s-eqiad: prepare to migrate airflow-search instance to k8soperations/deployment-chartsmaster+22 -13
Customize query in gerrit

Related Objects
Search...

Event Timeline

brouberol created this task.Nov 22 2024, 3:52 PM
Gehel triaged this task as High priority.Nov 25 2024, 1:34 PM
Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.Jan 8 2025, 8:40 AM
Gehel edited projects, added Data-Platform-SRE (2024.11.30 - 2024.12.20); removed Data-Platform-SRE.
gerritbot added a comment.Jan 9 2025, 3:24 PM

Change #1109436 had a related patch set uploaded (by Bking; author: Bking):

[operations/deployment-charts@master] dse-k8s-eqiad: prepare to migrate airflow-search instance to k8s

https://gerrit.wikimedia.org/r/1109436

gerritbot added a project: Patch-For-Review.Jan 9 2025, 3:24 PM
gerritbot added a comment.Jan 9 2025, 3:38 PM

Change #1109441 had a related patch set uploaded (by Bking; author: Bking):

[operations/deployment-charts@master] dse-k8s-eqiad: prepare to migrate airflow-search instance to k8s, part 2

https://gerrit.wikimedia.org/r/1109441

Stashbot added a comment.Jan 9 2025, 3:46 PM

Mentioned in SAL (#wikimedia-operations) [2025-01-09T15:46:39Z] <inflatador> bking@an-airflow1005 stopping airflow-search services as part of k8s migration T380615

gerritbot added a comment.Jan 9 2025, 3:50 PM

Change #1109436 merged by Bking:

[operations/deployment-charts@master] dse-k8s-eqiad: prepare to migrate airflow-search instance to k8s

https://gerrit.wikimedia.org/r/1109436

gerritbot added a comment.Jan 9 2025, 4:11 PM

Change #1109449 had a related patch set uploaded (by Bking; author: Bking):

[operations/deployment-charts@master] dse-k8s-eqiad: empty out values-postgresql-airflow-search.yaml

https://gerrit.wikimedia.org/r/1109449

gerritbot added a comment.Jan 9 2025, 4:19 PM

Change #1109449 merged by Bking:

[operations/deployment-charts@master] dse-k8s-eqiad: increase airflow-search pg instance disk size

https://gerrit.wikimedia.org/r/1109449

gerritbot added a comment.Jan 9 2025, 4:27 PM

Change #1109441 merged by Bking:

[operations/deployment-charts@master] dse-k8s-eqiad: prepare to migrate airflow-search instance to k8s, part 2

https://gerrit.wikimedia.org/r/1109441

Maintenance_bot removed a project: Patch-For-Review.Jan 9 2025, 4:30 PM
brouberol closed this task as Resolved.Jan 9 2025, 4:43 PM
brouberol assigned this task to bking.
brouberol moved this task from Backlog - project to Done on the Data-Platform-SRE (2024.11.30 - 2024.12.20) board.

All done!

Gehel moved this task from Done to Reported on the Data-Platform-SRE (2024.11.30 - 2024.12.20) board.Jan 10 2025, 8:57 AM
gerritbot added a comment.Jan 10 2025, 9:21 AM

Change #1109667 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/puppet@production] airflow-research: disable the airflow systemd services

https://gerrit.wikimedia.org/r/1109667

gerritbot added a project: Patch-For-Review.Jan 10 2025, 9:21 AM
gerritbot added a comment.Jan 10 2025, 9:46 AM

Change #1109667 merged by Brouberol:

[operations/puppet@production] airflow-research: disable the airflow systemd services

https://gerrit.wikimedia.org/r/1109667

Maintenance_bot removed a project: Patch-For-Review.Jan 10 2025, 10:30 AM
bking added a comment.Jan 10 2025, 2:30 PM

Reopening as there are some post-migration issues we need to fix, see this Google doc for more details.

bking reopened this task as In Progress.Jan 10 2025, 2:31 PM
Gehel edited projects, added Data-Platform-SRE (2025.01.11 - 2025.01.31); removed Data-Platform-SRE (2024.11.30 - 2024.12.20).Jan 10 2025, 3:13 PM
Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.01.11 - 2025.01.31) board.
bking closed this task as Resolved.Jan 30 2025, 2:37 PM
bking moved this task from In Progress to Done on the Data-Platform-SRE (2025.01.11 - 2025.01.31) board.
bking added a subscriber: dcausse.

Per IRC conversation with @dcausse , these issues have been address. As such, I'm closing out the ticket. Feel free to re-open if we missed something.

Gehel moved this task from Done to Reported on the Data-Platform-SRE (2025.01.11 - 2025.01.31) board.Jan 31 2025, 9:07 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits