WMDE Analytics Request
This task was generated using the WMDE Analytics request form. Please use the task templates linked on our project page to create tasks for the team. Thank you!
Why (Context & Decision)
What problem are you trying to solve, and what decision will this analysis inform? Briefly explain the organisational or strategic context, why this matters now, and what action will be taken based on the outcome.
In T434915 we will derive a method for identifying segments of Wikidata's data, which will include an as of now "Other" category being reduced so that we have a more clear breakdown of the categories ("Other is as of now the largest category").
What (Scope & Output)
Describe the specific question(s), metrics, segments, or deliverables (e.g., dashboard, deep dive, experiment analysis), including any relevant definitions or constraints.
We'll create a data process and then a dashboard to display the breakdown of the segments over time.
- Output: An Airflow DAG that calculates the Wikidata data segmentation on a monthly basis
- Output: a dashboard similar to this (this should also have an easily accessible list of which instance-of values are included in each category)
- Output: the same dashboard but limited to the Items that have at least one sitelink
By When (Timing & Priority)
Provide a clear deadline, any key milestones (e.g. launch, leadership review), and note if timing is flexible or fixed.
End of September / Mid-October
Information below this point is filled out by the analyst.
Sub Tasks
A breakdown of the steps to complete this task.
Data Pipeline Creation
- Define metric(s) to be derived from the new / updated data pipeline
- Define output table columns with stakeholder(s)
- Write job queries or code
- Test job queries or code
- Write Airflow DAG
- Test and deploy Airflow DAG
- Create Superset dashboard
Finishing Up
- Required documentation is written
- The task is moved to Delivered with the stakeholder being assigned and CCed in a comment
Data
The tables that will be referenced in this task and the sample sizes from them that will be used.
- link_to_table