Page MenuHomePhabricator

[Analytics] [Request] [WDQM] Move current data back one month and schedule to run at start of month
Open, Needs TriagePublic

Description

WMDE Analytics Request

This task was generated using the WMDE Analytics request form. Please use the task templates linked on our project page to create tasks for the team. Thank you!

Why (Context & Decision)

What problem are you trying to solve, and what decision will this analysis inform? Briefly explain the organisational or strategic context, why this matters now, and what action will be taken based on the outcome.

As of now the part of the Wikidata Quality metric that comprises a percent of external identifiers is delayed until the 15th of the month as this is when the editor that updates this information normally finalizes the update. This schedule is not ideal for reporting. We should switch it so that the job runs on the first of the month and gets the information from the previous month.

What (Scope & Output)

Describe the specific question(s), metrics, segments, or deliverables (e.g., dashboard, deep dive, experiment analysis), including any relevant definitions or constraints.

  • Changing the schedule of the external_identifier_completeness_monthly so that it runs on the first of the month
  • Integrating this value into the WDQM

By When (Timing & Priority)

Provide a clear deadline, any key milestones (e.g. launch, leadership review), and note if timing is flexible or fixed.

DD.MM.YYYY


Information below this point is filled out by the analyst.

Sub Tasks

A breakdown of the steps to complete this task.

Data Pipeline Creation
  • Update Airflow DAG
  • Test and deploy Airflow DAG
  • Update Superset dashboard
Finishing Up
  • Required documentation is written
  • The task is moved to Delivered with the stakeholder being assigned and CCed in a comment

Data

The tables that will be referenced in this task and the sample sizes from them that will be used.

  • wmf_content.mediawiki_content_current_v1