Page MenuHomePhabricator

[Analytics] [Request] Add bots to the WD API metrics
Open, Stalled, Needs TriagePublic

Description

WMDE Analytics Request

This task was generated using the WMDE Analytics request form. Please use the task templates linked on our project page to create tasks for the team. Thank you!

Why (Context & Decision)

What problem are you trying to solve, and what decision will this analysis inform? Briefly explain the organisational or strategic context, why this matters now, and what action will be taken based on the outcome.

IMPORTANT: This task is blocked by wmf.webrequest_v2 being available and T432436 being finished as ideally we should switch over the tables to using the new API request tables and then we'd add these fields in. Specifically we need T419522 to be finished as well as a followup task where bot_score will be added to wmf_traffic.api_requests_refined.
NOTE: We need to check with WMF about the timeline for adding bot_score to wmf_traffic.api_requests_refined.

Our older definition of filtered user was not reliable and the WMF will soon have a new table wmf.webrequest_v2 where they will include a bot scoring mechanism which will basically allow for what we originally wanted the filtered UAs to do --> to split out true UAs from nonsense usage.

What (Scope & Output)

Describe the specific question(s), metrics, segments, or deliverables (e.g., dashboard, deep dive, experiment analysis), including any relevant definitions or constraints.

  • WD API underlying tables have been added to include bot data

By When (Timing & Priority)

Provide a clear deadline, any key milestones (e.g. launch, leadership review), and note if timing is flexible or fixed.

10.08.2026 (this will vary based on when the table is available)


Information below this point is filled out by the analyst.

Sub Tasks

A breakdown of the steps to complete this task.

  • Wait for bot_score to be added into wmf_traffic.api_requests_refined.

Data

The tables that will be referenced in this task and the sample sizes from them that will be used.

  • wmf_traffic.api_requests_refined

Event Timeline

karapayneWMDE changed the task status from Open to Stalled.Mon, Aug 17, 12:29 PM
AndrewTavis_WMDE renamed this task from [Analytics] [Request] Use wmf.webrequest_v2 to add bots to the WD API metrics to [Analytics] [Request] Add bots to the WD API metrics.Tue, Aug 18, 7:22 AM