Page MenuHomePhabricator

[Analytics] [Request] Add new tile in data access dashboards showing retention and churn
Closed, ResolvedPublic5 Estimated Story Points

Description

Wikidata Analytics Request

This task was generated using the Wikidata Analytics request form. Please use the task templates linked on our project page to create tasks for the team. Thank you!

Purpose

We'd like to have two new metrics added to the WD API metrics dashboards. Namely these:

The metrics in question are -

  1. Returning user agents, so to check MoM, the amount of user agents that are the same as the month prior
  2. Churned user agents, so to check MoM, the amount of user agents that are NOT the same as the month prior

Why (Context & Decision)

This metric will help us keep track of retention and churn in our APIs and we can then accordingly solve for that

Desired Outputs

The desired outputs of this task are listed as check boxes and confirmed as being finished below.

Deadline

Please make the time sensitivity of this request clear with a date that it should be completed by. If there is no specific date, then the task will be triaged based on its priority.

15.8.2026


Information below this point is filled out by the task assignee.

Assignee Planning

Sub Tasks

A full breakdown of the steps to complete this task.

  • Check plan for task with stakeholder
    • Use the metadata tables that we already have
    • Insert user agents and whether they've retained or churned as a boolean into a table
    • Do counts on that table and insert it into another table for a persistent record
  • Write table creation and job queries
  • Write DAGs
  • Test table creation and job queries
  • Test DAGs
  • Deploy DAGs
  • Update Superset dashboards with charts based on the new data

Data

The tables that will be referenced in this task and the samples from them that will be used.

  • The wmde.wd_API_NAME_request_metadata_daily tables for each API will be used

Event Timeline

Ifrahkhanyaree_WMDE renamed this task from [Analytics] [Request] Add new tile in data access dashboards turning user agents for all data access methods to [Analytics] [Request] Add new tile in data access dashboards showing returning user agents.May 4 2026, 11:49 AM
Ifrahkhanyaree_WMDE updated the task description. (Show Details)
Ifrahkhanyaree_WMDE renamed this task from [Analytics] [Request] Add new tile in data access dashboards showing returning user agents to [Analytics] [Request] Add new tile in data access dashboards showing retention and churn.Jul 14 2026, 12:07 PM
karapayneWMDE set the point value for this task to 5.Jul 14 2026, 3:00 PM

The DAGs have been deployed and the charts have been made on Superset:dashboard/wmde_wd_api_metrics_monthly. We need two months of data for each run - the current month and the previous month to derive retention for the previous month using the current month. Because of this, we only have one month as we were able to do retention for May using the data for June (we don't have a full month for April anymore). In August we'll have our second month when we calculate the retention for June using the full data for July.