wdqs2016 and 2017 not consuming updates
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Gehel
	Apr 1 2025, 7:49 AM

Description

It looks like wdqs2016 and wdqs2017 are stuck and not processing updates. Logs show a Blazegraph NPE that seems to prevent the updater to continue processing updates (P74510).

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
deploy version 0.3.156	wikidata/query/deploy	master	+16 -18
Fix delete entity query	wikidata/query/rdf	master	+498 -5
Revert "deploy version 0.3.155"	wikidata/query/deploy	master	+18 -16

Customize query in gerrit

Related Objects

Mentioned Here: T326311: Deletion of Lexemes appears to leak triples related to its forms and senses
P74510 (An Untitled Masterwork)

Event Timeline

Gehel created this task.Apr 1 2025, 7:49 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 1 2025, 7:49 AM

Gehel triaged this task as High priority.Apr 1 2025, 7:50 AM

Gehel moved this task from Incoming to Current work on the Wikidata-Query-Service board.

Mentioned in SAL (#wikimedia-operations) [2025-04-01T08:14:38Z] <dcausse> T390665: restart blazegraph on wdqs2017

Maintenance_bot added a project: Wikidata.Apr 1 2025, 8:29 AM

Change #1133071 had a related patch set uploaded (by DCausse; author: DCausse):

[wikidata/query/deploy@master] Revert "deploy version 0.3.155"

https://gerrit.wikimedia.org/r/1133071

Change #1133071 merged by DCausse:

[wikidata/query/deploy@master] Revert "deploy version 0.3.155"

https://gerrit.wikimedia.org/r/1133071

We have created https://requestctl.wikimedia.org/action/cache-text/T390665-Wikidata-analysis-aws to limit the number of requests/s they can send us.

The effect is pretty drastic.

Screenshot 2025-04-01 at 11.13.07.png (1×2 px, 469 KB)

Screenshot 2025-04-01 at 11.12.55.png (2×2 px, 513 KB)

Maintenance_bot removed a project: Patch-For-Review.Apr 1 2025, 9:30 AM

I reverted T326311, the new query is completely broken and attempted to delete all lexeme data which thanksfully got killed before being able to do so.

Change #1133134 had a related patch set uploaded (by DCausse; author: DCausse):

[wikidata/query/rdf@master] Fix delete entity query

https://gerrit.wikimedia.org/r/1133134

gerritbot added a project: Patch-For-Review.Apr 1 2025, 1:03 PM

dcausse moved this task from In Progress to Needs Review on the Discovery-Search (2025.03.22 - 2025.04.11) board.Apr 1 2025, 1:15 PM

Change #1133134 merged by jenkins-bot:

[wikidata/query/rdf@master] Fix delete entity query

https://gerrit.wikimedia.org/r/1133134

Maintenance_bot removed a project: Patch-For-Review.Apr 3 2025, 5:30 PM

EBernhardson moved this task from Needs Review to To be Deployed on the Discovery-Search (2025.03.22 - 2025.04.11) board.Apr 3 2025, 9:00 PM

Change #1134710 had a related patch set uploaded (by DCausse; author: DCausse):

[wikidata/query/deploy@master] deploy version 0.3.156