Page MenuHomePhabricator

Projectviews by country Airflow job
Open, In Progress, Needs TriagePublic

Description

In part to teach Dan how to do Airflow, in part to serve a community request to get some data out, we are building a job to publish data that would feed into a visualization like: https://stats.wikimedia.org/wikimedia/animations/wivivi/wivivi.html

The context around the request comes from various volunteer-created tasks over the years as well as the community wishlist:

T257071: "Page views by edition of Wikipedia" for each country
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Search/Close_the_outdated_WiViVi_and_reintegrate_its_key_features_into_Wikimedia_Stats
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Multimedia_and_Commons/World_map_extension

Event Timeline

Dan already learned airflow from other jobs. The stale branch is in gitlab whenever someone picks this up: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/tree/projectview-by-country

JArguello-WMF changed the task status from Open to In Progress.Sep 28 2022, 4:09 PM
JArguello-WMF assigned this task to Snwachukwu.

@Snwachukwu / @JArguello-WMF Can you please assign at least one project to this task? It's currently sitting in the void of tasks with any projects attached.