Page MenuHomePhabricator

🧭Establish a guiding metric for query federation
Open, Needs TriagePublicGoal

Description

Background

We want to measure the capability of users to federate queries to different endpoints.
Possible metrics for this could be, for example:

  • # of other endpoints users successfully federated to
  • % of subqueries that failed because the target endpoint was not allowlisted

Task

Establish a logic for the guiding metric that we can use and take monthly baselines from the data available.

Acceptance Criteria

A script that can be run on a certain graph for a chosen period of time that returns a value for the metric or a list of values that the metric can be calculated from

Notes

We previously learnt to measure the amount of attempts to use the SERVICE syntax in the parsed queries.
If we build on this approach, we would need to cluster each row in this query into:

  • federation attempt to an allowlisted endpoint (success)
  • federation attempt to an allowlisted endpoint (failed)
  • federation attempt to non-allowlisted endpoint
  • self-federation attempt (federation to the same graph where the query is running on)
  • non-federation (invoking a helper service)
  • could not cluster.

The tickets to make such clustering possible are: T399805, T399827, T399828, T399831

Another approach would also be to analyze the actual logs of outgoing subqueries and cluster those (in this case we will not need the 'non-federation' category, because no subquery is being produced in this case).
A single ticket was created for this investigation: T399829

Event Timeline

Anton.Kokh renamed this task from 🧭Establish a guiding metric for measuring # of queries attempting to federate to endpoints that are not Allowisted to 🧭Establish a guiding metric for measuring # of queries attempting to federate to endpoints that are not Allowlisted.Jul 11 2025, 2:41 PM
Anton.Kokh changed the subtype of this task from "Task" to "Goal".
Anton.Kokh renamed this task from 🧭Establish a guiding metric for measuring # of queries attempting to federate to endpoints that are not Allowlisted to 🧭Establish a guiding metric for query federation.Jul 17 2025, 7:53 AM
Anton.Kokh updated the task description. (Show Details)

I'd love to see into https://docs.google.com/spreadsheets/d/1okCL1QeGpOp5VyZynM_CxuEA6fg7_4Y0b3eR7_HKXwM/edit?gid=0#gid=0 and see how
Does that need to be private / can the interesting bit about how be published somewhere?

@Addshore I opened access to your email that I found here :)

Making a note here: This work falls under the purview of the WBR team now and Anton was kind enough to let me reuse this ticket