Maniphest T195258

[weird] Wikidata SPARQL query results not the same when exported
Closed, ResolvedPublic8 Estimated Story Points
Actions

Assigned To

Authored By

	VIGNERON
	May 21 2018, 7:19 PM

Description

Hi,

Tonight I stumbled upon my weirdest wikidata-related bug so far.

I do a simple query on http://query.wikidata.org/ (list of embassies in France : http://tinyurl.com/y8yq6oq8 ) ; I've got the correct results. But I export (either in TSV, TSV verbose, CSV or HTML) I've got totally different data.

Weirder, when I ask on Twitter (https://twitter.com/belett/status/998636026900959233), no one else seem to have this bug.

Even weirder, I tested and the bug appears on Firefox (60.0.1 - 64 bits) but not on Chrome nor on Edge Oo

Details

	Subject	Repo	Branch	Lines +/-
	Merging from 97444f08bcfd9e0ac90ae8a61cbbb7428fc625c3:	wikidata/query/gui-deploy	production	+5 -5
	Fix: Wikidata SPARQL query results not the same when exported	wikidata/query/gui	master	+3 -1

Customize query in gerrit

Related Objects

Mentioned In: rWDQG97444f08bcfd: Fix: Wikidata SPARQL query results not the same when exported
Mentioned Here: rWDQG97444f08bcfd: Fix: Wikidata SPARQL query results not the same when exported
T193861: WDQS UI reports absurd query runtime if auxiliary queries are run concurrently with the main query

Event Timeline

VIGNERON created this task.May 21 2018, 7:19 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 21 2018, 7:19 PM

Huh, I can reproduce this on my work laptop, but not on my private PC… (both using Firefox)

VIGNERON updated the task description. (Show Details)May 21 2018, 7:33 PM

The language in which I get the online query is correct, the one requested with SERVICE wikibase:label, while the language of the dump is the one configured for the Wikidata Query UI.

From the command line, the output is also correct.

$ curl 'https://query.wikidata.org/sparql?query=SELECT%20%3Fq%20%3FqLabel%20WHERE%20%7B%0A%20%20%3Fq%20wdt%3AP31%20wd%3AQ3917681%20%3B%20wdt%3AP17%20wd%3AQ142%20.%0A%20%20SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22fr%2Cen%22.%20%7D%0A%7D%0A'

abian added a comment.May 21 2018, 8:28 PM

This comment was removed by abian.

I thought this was because of the ;, but seems to be more complex, sometimes it happens and sometimes it doesn't.

New development, today, on the Status updates I see the same kind of bug (columns given are not what is asked on the SELECT) but on the online result itself (so before export) : query

In T195258#4221900, @VIGNERON wrote:

New development, today, on the Status updates I see the same kind of bug (columns given are not what is asked on the SELECT) but on the online result itself (so before export) : query

And it disappeared, very strange bug...

I can’t reproduce it anymore either.

But in any event… the only network requests triggered by the download buttons that I can see is one request to statsv, to track the button click. As strange as it is, somehow this bug must be happening client-side… unless there are extra network requests when the bug can be reproduced?

I reproduced this bug today with this request with Firefox, and someone I know reproduced it today and yesterday on his computer with different queries. Yesterday he was able to pass over this bug by changing a comment (to re-compute the query). I just asked on IRC and User:Pintoch said s/he saw this bug too.

I think this is misc. queries getting downloaded, but not the displayed one. Way to reproduce: Run a query, click "Show" in the "Query Helper" on the left, download the result.

I have observed this bug multiple times now (also using Firefox).

I think this is misc. queries getting downloaded, but not the displayed one. Way to reproduce: Run a query, click "Show" in the "Query Helper" on the left, download the result.

OOOOOHHHhhhh. That.

So basically the same thing as T193861: WDQS UI reports absurd query runtime if auxiliary queries are run concurrently with the main query – auxiliary queries being mixed up with the main query, except this time it affects the download instead of the runtime? That explains why the query looked similar but the result columns were altered, I think.

• Vvjjkkii renamed this task from [weird] Wikidata SPARQL query results not the same when exported to hjcaaaaaaa.Jul 1 2018, 1:09 AM

• Vvjjkkii triaged this task as High priority.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed a subscriber: Aklapper.

CommunityTechBot renamed this task from hjcaaaaaaa to [weird] Wikidata SPARQL query results not the same when exported.Jul 2 2018, 4:00 PM

CommunityTechBot raised the priority of this task from High to Needs Triage.

CommunityTechBot updated the task description. (Show Details)

CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

CommunityTechBot added a subscriber: Aklapper.

• Jonas added a project: Wikidata-Campsite.Aug 28 2018, 11:07 AM

• Jonas moved this task from Incoming to Ready to estimate on the Wikidata-Campsite board.Sep 4 2018, 1:26 PM

Addshore subscribed.Sep 4 2018, 1:27 PM

• Jonas set the point value for this task to 8.Sep 4 2018, 1:31 PM

• Jonas moved this task from Ready to estimate to In Progress on the Wikidata-Campsite board.

@Jonas should this be on Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) as it is estimated and in the "In progress" col? Did we pick it up?

Yes, it should. I added it.

Addshore moved this task from incoming to in progress on the Wikidata board.Sep 18 2018, 2:25 PM

Addshore triaged this task as Medium priority.Sep 19 2018, 7:02 AM

Pintoch unsubscribed.Sep 19 2018, 12:40 PM

• Jonas claimed this task.Sep 21 2018, 12:17 PM

• Jonas moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

Change 461949 had a related patch set uploaded (by Jonas Kress (WMDE); owner: Jonas Kress (WMDE)):
[wikidata/query/gui@master] Fix: Wikidata SPARQL query results not the same when exported

https://gerrit.wikimedia.org/r/461949

gerritbot added a project: Patch-For-Review.Sep 21 2018, 12:55 PM

Unfortunately I can not reproduce the problem.
I have an idea what could be wrong and fixed it.

• Jonas moved this task from Doing to Peer Review on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Sep 21 2018, 12:59 PM

• Jonas mentioned this in rWDQG97444f08bcfd: Fix: Wikidata SPARQL query results not the same when exported.Sep 21 2018, 12:59 PM

Change 461949 merged by jenkins-bot:
[wikidata/query/gui@master] Fix: Wikidata SPARQL query results not the same when exported

https://gerrit.wikimedia.org/r/461949

Change 461995 had a related patch set uploaded (by WDQSGuiBuilder; owner: WDQSGuiBuilder):
[wikidata/query/gui-deploy@production] Merging from 97444f08bcfd9e0ac90ae8a61cbbb7428fc625c3:

https://gerrit.wikimedia.org/r/461995

Change 461995 merged by Smalyshev:
[wikidata/query/gui-deploy@production] Merging from 97444f08bcfd9e0ac90ae8a61cbbb7428fc625c3:

https://gerrit.wikimedia.org/r/461995

• Jonas moved this task from Peer Review to Test (Verification) on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Sep 24 2018, 7:22 AM

Lydia_Pintscher closed this task as Resolved.Sep 26 2018, 9:02 AM

Lydia_Pintscher moved this task from Test (Verification) to Done on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

Addshore removed a project: Wikidata-Campsite.Nov 1 2018, 11:22 AM