Maniphest T277637

Report latency metric to the wdqs-ui from the wdqs streaming updater
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	dcausse
	Mar 17 2021, 8:40 AM

Tags

Referenced Files

None

Subscribers

Description

As a user of the WDQS UI I want to know the lag of the servers so that I can more easily evaluate if the results I see are stale.

The way it is designed today is to use a dedicated triple in the store:

<http://www.wikidata.org> schema:dateModified "2021-03-12T20:59:57Z"^^xsd:dateTime

This triple being an artifact of the update it was decided to not maintain it with the new updater. Reason was that the triple seemed the wrong choice for storing metrics regarding the health of the system.

On the other hand the WDQS UI is currently reporting the lag metric using this triple despite being inaccurate (there are no guarantee that the lag reported is from the same server than the one that will serve the results displayed).

Short term solution is perhaps to still maintain this triple from the new updater and figure out better long term solution to properly inform users of the latency of the results they see.

AC:

the triple <http://www.wikidata.org> schema:dateModified TIMESTAMP is maintained by the new updater
create a ticket describing a better long term solution

Details

	Subject	Repo	Branch	Lines +/-
	Maintain latency metric in the triple store	wikidata/query/rdf	master	+154 -69

Customize query in gerrit

Related Objects

Mentioned Here: T278246: Report WDQS update latency when displaying/serving results

Event Timeline

dcausse created this task.Mar 17 2021, 8:40 AM

Restricted Application added a project: Wikidata. · View Herald TranscriptMar 17 2021, 8:40 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• MPhamWMF moved this task from Incoming to Current work on the Wikidata-Query-Service board.Mar 22 2021, 3:25 PM

• MPhamWMF added a project: Discovery-Search (Current work).

• MPhamWMF set the point value for this task to 3.Mar 22 2021, 3:34 PM

• MPhamWMF moved this task from Incoming to Ready for Dev -- SWE on the Discovery-Search (Current work) board.

dcausse claimed this task.Mar 23 2021, 7:52 AM

dcausse moved this task from incoming to in progress on the Wikidata board.

Change 674408 had a related patch set uploaded (by DCausse; owner: DCausse):
[wikidata/query/rdf@master] Maintain latency metric in the triple store

https://gerrit.wikimedia.org/r/674408

gerritbot added a project: Patch-For-Review.Mar 23 2021, 6:12 PM

Suggestion for a better long term solution here: T278246

dcausse moved this task from Ready for Dev -- SWE to Needs review on the Discovery-Search (Current work) board.Mar 23 2021, 6:13 PM

dcausse moved this task from in progress to incoming on the Wikidata board.

Change 674408 merged by jenkins-bot:
[wikidata/query/rdf@master] Maintain latency metric in the triple store

https://gerrit.wikimedia.org/r/674408

Maintenance_bot removed a project: Patch-For-Review.Mar 24 2021, 12:10 PM

dcausse moved this task from Needs review to To Be Deployed on the Discovery-Search (Current work) board.Mar 29 2021, 7:37 AM

dcausse moved this task from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board.

Gehel closed this task as Resolved.Apr 7 2021, 8:28 AM