Page MenuHomePhabricator
Create Task
Maniphest T303193

Projectviews by country Airflow job
Open, Needs TriagePublic
Actions

Description

In part to teach Dan how to do Airflow, in part to serve a community request to get some data out, we are building a job to publish data that would feed into a visualization like: https://stats.wikimedia.org/wikimedia/animations/wivivi/wivivi.html

The context around the request comes from various volunteer-created tasks over the years as well as the community wishlist:

T257071: "Page views by edition of Wikipedia" for each country
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Search/Close_the_outdated_WiViVi_and_reintegrate_its_key_features_into_Wikimedia_Stats
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Multimedia_and_Commons/World_map_extension

Related Objects

Event Timeline

Milimetric created this task.Mar 7 2022, 4:05 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 7 2022, 4:05 PM
Milimetric claimed this task.Mar 7 2022, 4:05 PM
Milimetric added a project: Data-Engineering.
• odimitrijevic added a project: Data Pipelines.Mar 10 2022, 6:03 PM
Milimetric mentioned this in T250001: Country pageview breakdown by language.Mar 10 2022, 7:52 PM
• odimitrijevic moved this task from Incoming (new tickets) to Datasets on the Data-Engineering board.Mar 11 2022, 4:48 PM
• EChetty moved this task from Backlog to Next Up (revisit every 2 sprints) on the Data Pipelines board.Jun 28 2022, 6:26 PM
JArguello-WMF edited projects, added: Data-Engineering-Planning; removed: Data-Engineering.Jun 30 2022, 3:16 PM
JArguello-WMF edited projects, added: Data-Engineering-Planning (Sprint 01); removed: Data-Engineering-Planning.Jun 30 2022, 3:34 PM
JArguello-WMF moved this task from Ready to In progress on the Data-Engineering-Planning (Sprint 01) board.Jun 30 2022, 3:38 PM
• EChetty removed a project: Data-Engineering-Planning (Sprint 01).Jun 30 2022, 5:07 PM
• EChetty moved this task from Next Up (revisit every 2 sprints) to Discussed (Radar) on the Data Pipelines board.Aug 19 2022, 11:22 AM
Milimetric added a comment.Aug 23 2022, 5:24 PM

Dan already learned airflow from other jobs. The stale branch is in gitlab whenever someone picks this up: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/tree/projectview-by-country

Milimetric removed Milimetric as the assignee of this task.Aug 23 2022, 5:24 PM
• EChetty moved this task from Discussed (Radar) to Sprint 02 on the Data Pipelines board.Sep 26 2022, 3:19 PM
• EChetty edited projects, added: Data Pipelines (Sprint 02); removed: Data Pipelines.
• EChetty moved this task from Ready to Blocked/Paused on the Data Pipelines (Sprint 02) board.
JArguello-WMF changed the task status from Open to In Progress.Sep 28 2022, 4:09 PM
JArguello-WMF assigned this task to Snwachukwu.
JArguello-WMF moved this task from Blocked/Paused to In Progress on the Data Pipelines (Sprint 02) board.
• EChetty edited projects, added: Data Pipelines; removed: Data Pipelines (Sprint 02), Data-Engineering-Kanban.Sep 29 2022, 4:07 PM
• EChetty moved this task from Backlog to Sprint 02 on the Data Pipelines board.Oct 14 2022, 8:42 AM
• EChetty edited projects, added: Data Pipelines (Sprint 02); removed: Data Pipelines.
• EChetty moved this task from In Progress to Ready to Deploy on the Data Pipelines (Sprint 02) board.Oct 14 2022, 2:03 PM
• EChetty moved this task from Ready to Deploy to Done on the Data Pipelines (Sprint 02) board.Oct 17 2022, 11:10 AM
• EChetty moved this task from Sprint 02 to Sprint 03 on the Data Pipelines board.Oct 17 2022, 3:07 PM
• EChetty edited projects, added: Data Pipelines (Sprint 03); removed: Data Pipelines (Sprint 02).
• EChetty moved this task from Ready to Ready to Deploy on the Data Pipelines (Sprint 03) board.Oct 17 2022, 3:16 PM
• EChetty removed a project: Data Pipelines (Sprint 03).
Peachey88 added subscribers: JArguello-WMF, Peachey88.Feb 21 2024, 9:10 AM

@Snwachukwu / @JArguello-WMF Can you please assign at least one project to this task? It's currently sitting in the void of tasks with any projects attached.

Aklapper added a project: Data Pipelines.Mar 18 2024, 1:19 PM
Aklapper changed the task status from In Progress to Open.Mar 22 2025, 7:22 AM

Resetting task status from "In Progress" to "Open" as this task has been "in progress" for more than two years.

Aklapper removed Snwachukwu as the assignee of this task.Jun 24 2025, 12:21 PM
Aklapper added a subscriber: Snwachukwu.

@Snwachukwu: Removing task assignee as this open task has been assigned for more than two years - See the email sent on 2025-05-22.
Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome!
If this task has been resolved in the meantime, or should not be worked on by anybody ("declined"), please update its task status via "Add Action… 🡒 Change Status".
Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator. Thanks!

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits