Hypothesis WE2.5.1: setup triple stores in eqiad
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	gmodena
	Jan 16 2026, 10:31 AM

Description

Hypothesis text

If we deploy the Blazegraph candidate replacement in eqiad and augment existing evaluation work with production WDQS traffic-replay analysis, then we will confirm that the new backend performs comparably, supports real-world SPARQL queries, and is ready for limited live-traffic exposure once the surrounding ecosystem (UI, monitoring, onboarding, and real-time index update pipeline) is prepared.

Milestones

High level implementation goals (subset of ACs defined for the hypothesis).

QLever and Virtuoso instances are available internally in eqiad
AWS tests have been fully reproduced on-prem, and augmented with full support to replay traffic from WDQS query logs.
We implemented, or at least prototyped, a solution to to support label and mwapi services.
Instances of Query UI are available for limited, internal, access to test databases.
Changes required to Grafana dashboards and Prometheus alerting required to support live traffic have been documented.

Related Objects
Search...

Status	Assigned	Task
Open	None	T414782 Hypothesis WE2.5.1: setup triple stores in eqiad
Stalled	gmodena	T414443 Setup WDQS instances on test eqiad nodes.
In Progress	gmodena	T414447 Propagate real-time wikidata changes to WDQS test nodes
Resolved	gmodena	T414450 Replay wdqs-external queries to test eqiad nodes from stat machines
In Progress	trueg	T414453 [SPIKE] How to handle porting of label and mwapi services to the new backend
In Progress	trueg	T417744 Explore potential for SPARQL extensions in QLever
		Restricted Task
Resolved	trueg	T414306 wdqs: alert on ratio of failed queries increase
Open	None	T413229 Application Security Review Request : WDQS
Resolved	gmodena	T414559 establish a baseline for dumps ingestion performance on eqiad nodes
Open	None	T415672 Query UI and Query Builder services for test databases should available on k8s.
Open	None	T415676 Request: namespaces for wikidata-query-ui in dse-k8s
In Progress	trueg	T417414 queryhammer: implement CI and deployment pipeline
Open	None	T417415 Request: k8s namespace for wdqs traffic replay harness
Resolved	gmodena	T414829 Add Query Response Time to WDQS reporting
Open	None	T418837 [NEEDS GROOMING] deploy wdqs rewrite proxy in front of test eqiad instances

Event Timeline

gmodena created this task.Jan 16 2026, 10:31 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 16 2026, 10:31 AM

gmodena renamed this task from Hypothesis 5.2.1 Setup triple stores in eqiad to Hypothesis 5.2.1: setup triple stores in eqiad.Jan 16 2026, 10:31 AM

gmodena added a subtask: T414443: Setup WDQS instances on test eqiad nodes..

gmodena added a subtask: T414447: Propagate real-time wikidata changes to WDQS test nodes.

gmodena added a subtask: T414450: Replay wdqs-external queries to test eqiad nodes from stat machines.

gmodena added a subtask: T414453: [SPIKE] How to handle porting of label and mwapi services to the new backend.Jan 16 2026, 10:34 AM

gmodena added a subtask: T414306: wdqs: alert on ratio of failed queries increase.Jan 16 2026, 10:36 AM

gmodena added a subtask: T413229: Application Security Review Request : WDQS.

gmodena added a subtask: T414559: establish a baseline for dumps ingestion performance on eqiad nodes.

BTullis subscribed.Jan 16 2026, 10:42 AM

Maintenance_bot added a project: Wikidata.Jan 16 2026, 11:30 AM

gmodena created subtask T415672: Query UI and Query Builder services for test databases should available on k8s..Jan 27 2026, 2:44 PM

trueg closed subtask T414306: wdqs: alert on ratio of failed queries increase as Resolved.Jan 29 2026, 10:47 AM

trueg reopened subtask T414306: wdqs: alert on ratio of failed queries increase as In Progress.

gmodena renamed this task from Hypothesis 5.2.1: setup triple stores in eqiad to Hypothesis 2.5.1: setup triple stores in eqiad.Fri, Feb 13, 3:12 PM

gmodena added a subtask: T417414: queryhammer: implement CI and deployment pipeline.

gmodena renamed this task from Hypothesis 2.5.1: setup triple stores in eqiad to Hypothesis WE2.5.1: setup triple stores in eqiad.Tue, Feb 17, 12:44 PM

gmodena mentioned this in T415492: Request: make main and scholarly graphs available on WDQS test nodes.

gmodena added a project: Wikidata Platform Team.Tue, Feb 17, 1:11 PM

DSantamaria added a project: OKR-Work.Tue, Feb 17, 1:56 PM

DSantamaria changed the status of subtask T414443: Setup WDQS instances on test eqiad nodes. from Open to Stalled.Tue, Feb 17, 2:09 PM

DSantamaria added a subtask: T414829: Add Query Response Time to WDQS reporting.Tue, Feb 17, 2:14 PM

trueg changed the status of subtask T414453: [SPIKE] How to handle porting of label and mwapi services to the new backend from Open to In Progress.Wed, Feb 18, 8:56 AM

gmodena changed the status of subtask T414447: Propagate real-time wikidata changes to WDQS test nodes from Open to In Progress.Wed, Feb 18, 1:43 PM

DSantamaria edited projects, added Wikidata Platform Team (Sprint 02 (2026/02/09)); removed Wikidata Platform Team.Tue, Feb 24, 8:53 AM

BTracy-WMF closed subtask T414559: establish a baseline for dumps ingestion performance on eqiad nodes as Resolved.Thu, Feb 26, 12:03 PM

BTracy-WMF closed subtask T414450: Replay wdqs-external queries to test eqiad nodes from stat machines as Resolved.

BTracy-WMF closed subtask T414306: wdqs: alert on ratio of failed queries increase as Resolved.

gmodena created subtask T418837: [NEEDS GROOMING] deploy wdqs rewrite proxy in front of test eqiad instances.Tue, Mar 3, 9:56 AM