Migrate rdf_streaming_updater_reconcile.py from airflow 1 to airflow 2
Closed, ResolvedPublic2 Estimated Story Points
Actions

Assigned To

Authored By

	EBernhardson
	Feb 16 2023, 6:51 PM

Details

Other Assignee: EBernhardson

Related Objects
Search...

Status	Assigned	Task
Resolved	Gehel	T322905 [EPIC] Upgrade Search Platform spark jobs to spark 3
Resolved	Gehel	T318414 [Tracking] Migrate Search Airflow jobs to Airflow 2 and use shared supporting code from the data engineering Airflow
Resolved	dcausse	T329879 Migrate rdf_streaming_updater_reconcile.py from airflow 1 to airflow 2

Event Timeline

EBernhardson created this task.Feb 16 2023, 6:51 PM

EBernhardson closed this task as a duplicate of T327381: Migrate RDF Tooling to Spark 3.Feb 16 2023, 6:56 PM

re-opening. Considering the Migrate RDF Tooling task to be about migrating the code and releasing the jar, will create tasks for each dag file that needs to be migrated as well.

TJones set the point value for this task to 2.Feb 27 2023, 4:22 PM

TJones moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.Feb 27 2023, 4:30 PM

lbowmaker moved this task from Backlog to Radar on the Data-Engineering-Planning board.Mar 3 2023, 2:42 PM

pfischer claimed this task.Mar 6 2023, 7:45 AM

pfischer moved this task from Ready for Dev -- SWE to In Progress on the Discovery-Search (Current work) board.

pfischer reassigned this task from pfischer to dcausse.Mar 6 2023, 8:26 AM

pfischer moved this task from In Progress to Needs review on the Discovery-Search (Current work) board.

pfischer updated Other Assignee, added: EBernhardson.

pfischer subscribed.

pfischer merged a task: T330450: Migrate rdf_streaming_updater_reconcile.py from airflow 1 to airflow 2.Mar 6 2023, 4:14 PM

pfischer added subscribers: Gehel, MPhamWMF.

pfischer merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/258