Airflow Hackathon (May 2022)
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	mforns
	May 3 2022, 7:55 PM

Description

This is the parent task of Data Engineering Airflow hackathon (May 2022).
Its child tasks are the potential things to work on during the hackathon.

Details

Due Date: May 31 2022, 9:00 PM

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T307500 Airflow Hackathon (May 2022)
Open	None	T307505 Refine jobs should be scheduled by Airflow
Open	None	T312785 Change the way Refine handles its status (currently flags in partitions)
Resolved	Antoine_Quhen	T356192 [Refine refactoring] Refactor and migrate navigationtiming to Airflow
Open	JAllemandou	T356363 [Refine Refactoring] Refactor refinery code for compatibility with Airflow integration
Resolved	tchin	T355542 [Dataset Config Store] - Define config API for navigationtiming and implement local development instance
Open	Antoine_Quhen	T356362 [Refine Refactoring] [Spike] Define a concept and provide a PoC for dynamic DAG execution in Airflow
Open	None	T307508 Migrate 1+ Druid load jobs
Open	mforns	T307540 [Airflow Migration] Migrate reportupdater jobs
Open	None	T333537 Deprecate WMDE Technical Wishes reportupdater jobs
Open	amastilovic	T354552 [Maintenance] Migrate ReportUpdater browser queries to Airflow
Resolved	amastilovic	T356424 [Maintenance] Migrate cx ReportUpdater job
Open	amastilovic	T357372 [Maintenance] Migrate pingback to Airflow
Resolved	JAllemandou	T357419 Turn off ReportUpdater jobs no longer used
Open	None	T358210 Delete reportupdater jobs data/puppet-code
Open	amastilovic	T357938 [Maintenance] Migrate wmcs to Airflow
Resolved	mforns	T305841 Migrate unique devices jobs
Resolved	mforns	T319213 Backfill unique devices jobs [Tracking Task]
Resolved	JAllemandou	T307569 [Oozie Migration] Migrate edit hourly job
Resolved	Snwachukwu	T305844 Migrate the projectview jobs
Resolved	Snwachukwu	T309023 Update and add copies of projectview hql script to analytics/refinery/hql path
Resolved	JEbe-WMF	T305842 Migrate the referrer job