WE2.5.6 Data quality and query validation
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	DSantamaria
	Apr 7 2026, 3:39 PM

Description

If we develop the capability to automate output comparison between WDQS v1 and v2 for selected sets of queries, we will be able to improve confidence in the correctness of the new service.

Related Objects
Search...

Status	Assigned	Task
Open	gmodena	T422521 WE2.5.6 Data quality and query validation
Duplicate	None	T421298 [NEEDS GROOMING] implement a test harness for data quality and query validation
In Progress	gmodena	T422097 Create the capability to send queries to 2 backends and compare results
Stalled	AWesterinen-WMF	T424453 Rewrite collected queries to use only SPARQL 1.1 concepts and features
Resolved	AWesterinen-WMF	T426646 Create WikiTech pages for the testing architecture and query characterization docs
Stalled	AWesterinen-WMF	T427995 Create code to perform query rewrites defined in peer sub-tasks
Resolved	gmodena	T423403 test infra: deploy main and scholarly blazegraph instances
Resolved	AWesterinen-WMF	T424304 [SPIKE] Design architecture for collection and rewriting of queries and comparison against different backends
Resolved	AWesterinen-WMF	T424305 [SPIKE] Define SPARQL query characterization
Open	AWesterinen-WMF	T424306 Define and document specific approaches to supporting Blazegraph-specific functionality in SPARQL 1.1
Open	AWesterinen-WMF	T425470 Rewrite pattern for geospatial related Blazegraph-specific features
In Progress	AWesterinen-WMF	T425472 Rewrite pattern for GAS service
In Progress	AWesterinen-WMF	T425473 Rewrite pattern for MWAPI service and search functionality
Open	AWesterinen-WMF	T425492 Rewrite patterns for utility and other Blazegraph functions/features
Open	AWesterinen-WMF	T424452 Collect 24hr query logs from current WDQS
Resolved	AWesterinen-WMF	T425386 [SPIKE] Create notebook to query event Hives and extract queries
Open	AWesterinen-WMF	T424454 Categorize comparison queries and analyze results relative to their characteristics
Open	None	T426864 wdqs internal endpoint rewrites

Event Timeline

DSantamaria created this task.Apr 7 2026, 3:39 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 7 2026, 3:39 PM

DSantamaria added a subtask: T422097: Create the capability to send queries to 2 backends and compare results.Apr 8 2026, 1:23 PM

DSantamaria added a subtask: T421298: [NEEDS GROOMING] implement a test harness for data quality and query validation.Apr 8 2026, 1:37 PM

gmodena created subtask T423403: test infra: deploy main and scholarly blazegraph instances.Apr 15 2026, 10:35 AM

gmodena changed the status of subtask T423403: test infra: deploy main and scholarly blazegraph instances from Open to In Progress.Apr 15 2026, 1:12 PM

gmodena merged a task: T421298: [NEEDS GROOMING] implement a test harness for data quality and query validation.Apr 15 2026, 1:25 PM

gmodena added subscribers: gmodena, Physikerwelt, Pfps.

DSantamaria renamed this task from [Hypothesis] WE2.5.6 Data quality and query validation to WE2.5.6 Data quality and query validation.Apr 17 2026, 5:54 AM

gmodena removed a subtask: T422097: Create the capability to send queries to 2 backends and compare results.Apr 21 2026, 3:25 PM

gmodena mentioned this in T422097: Create the capability to send queries to 2 backends and compare results.Apr 21 2026, 3:30 PM

gmodena mentioned this in T423166: [NEEDS GROOMING] Curate a list of representative queries using the label service and no other special features.Apr 23 2026, 12:45 PM

AWesterinen-WMF added a subtask: T424304: [SPIKE] Design architecture for collection and rewriting of queries and comparison against different backends.Apr 24 2026, 4:19 AM

AWesterinen-WMF added a subtask: T424305: [SPIKE] Define SPARQL query characterization.

AWesterinen-WMF changed the status of subtask T424305: [SPIKE] Define SPARQL query characterization from Open to In Progress.Apr 24 2026, 4:22 AM

AWesterinen-WMF changed the status of subtask T424304: [SPIKE] Design architecture for collection and rewriting of queries and comparison against different backends from Open to In Progress.

AWesterinen-WMF created subtask T424306: Define and document specific approaches to supporting Blazegraph-specific functionality in SPARQL 1.1.Apr 24 2026, 4:34 AM

AWesterinen-WMF created subtask T424452: Collect 24hr query logs from current WDQS.Apr 26 2026, 8:05 PM

AWesterinen-WMF created subtask T424454: Categorize comparison queries and analyze results relative to their characteristics.Apr 26 2026, 8:25 PM

gmodena mentioned this in T424865: request: access wdqs::alternatives nodes from stats and hadoop nodes..Apr 29 2026, 3:20 PM

gmodena closed subtask T423403: test infra: deploy main and scholarly blazegraph instances as Resolved.May 4 2026, 11:16 AM