Page MenuHomePhabricator

Huggle (software rollback) sometimes replaces Unicode-characters with garbage on some systems
Closed, ResolvedPublic

Description

This is "almost" copied from https://en.wikipedia.org/wiki/Wikipedia:Huggle/Feedback#Problems_with_some_unicode_characters

Huggle came into trouble with some unicode characters and replaced them with garbage.

See:

  1. https://de.wikipedia.org/w/index.php?oldid=131448530&diff=prev (vanalism)
  2. https://de.wikipedia.org/w/index.php?oldid=131448530&diff=next (revert+garbage)

Reported by User:IW (https://en.wikipedia.org/wiki/User:Inkowik) at 18:31, 19 June 2014 (UTC)


Version: unspecified
Severity: major

Details

Reference
bz66856

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 3:26 AM
bzimport added a project: Huggle.
bzimport set Reference to bz66856.

original report at https://de.wikipedia.org/w/index.php?title=Wikipedia_Diskussion:Huggle&diff=131449475
reported for version "huggle 3.0.2 build: 1616 3.0.2"
original unicode character in question is 3 bytes long (ⅷ; hex: e2 85 b7)

of course it is, otherwise it would be mw bug...

https://github.com/huggle/huggle3-qt-lx/blob/master/huggle/generic.cpp

QString Generic::EvaluateWikiPageContents is what is responsible for parsing the output of MW api that contains RAW text of wiki page. If there is some problem with encoding it is probably somewhere in this function.

Question is: does huggle read the string malformed, or does it write it malformed?

can you try with latest huggle on test wiki?

maybe it only affect users on windows

lowering priority as this is affecting only some users

it works to me even on windows 7

lowering priority as it's very hard to reproduce, we need some assistance of users who are affected in order to fix it

super simple workaround is to get the rollback permissions as this affect software rollback only

whoever has this problem needs to run huggle in --qd mode and send me the log file as soon as this problem happen to them

Petrb changed the task status from Open to Stalled.Jan 28 2015, 11:20 AM
Petrb lowered the priority of this task from High to Low.

In link 1 it had problem reverting %u2177
In link 2 it seems to have trouble reverting %u0643 and %u0645
In link 3 it had problem revering %u0430, %u043E, %u0435 and %u0413

Just wanted to mention this for future references...

That's not true, I tried replicating the issue using exactly same
symbols and it did revert them just fine on test wikis. It seems there
is some relation to users locale settings or something.

Until I am able to simulate this bug within debugger I won't be able to fix it

Not sure if relevant, but one side of this diff has those question-mark-sings while the other has a ä, without any change made to that section in that edit.

qwoyv.jpg (768×1 px, 512 KB)

1tor aug 27 16:17:03 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Greta%20Ericson&rawcontinue=1&format=xml
2tor aug 27 16:17:03 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=78.70.156.204&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
3tor aug 27 16:17:03 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Greta%20Ericson&rawcontinue=1&format=xml
4tor aug 27 16:17:03 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=78.70.156.204&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
5tor aug 27 16:16:56 2015 DEBUG[1]: Invalid date: Jag ser
6tor aug 27 16:16:56 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417404&rvdiffto=prev&titles=Anv%C3%A4ndare%3AAasalindh12556%2Fsandl%C3%A5da&rawcontinue=1&format=xml
7tor aug 27 16:16:56 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A90.231.154.54&rawcontinue=1&format=xml
8tor aug 27 16:16:56 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417404&rvdiffto=prev&titles=Anv%C3%A4ndare%3AAasalindh12556%2Fsandl%C3%A5da&rawcontinue=1&format=xml
9tor aug 27 16:16:56 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A90.231.154.54&rawcontinue=1&format=xml
10tor aug 27 16:16:42 2015 DEBUG[1]: Invalid date: uppmärksamhet och
11tor aug 27 16:16:42 2015 DEBUG[1]: Invalid date: va? /[[Användare:Julle|Julle]]
12tor aug 27 16:16:42 2015 DEBUG[1]: Invalid date: men insatserna
13tor aug 27 16:16:42 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A78.70.156.204&rawcontinue=1&format=xml
14tor aug 27 16:16:42 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417403&rvdiffto=prev&titles=Greta%20Ericson&rawcontinue=1&format=xml
15tor aug 27 16:16:42 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417403&rvdiffto=prev&titles=Greta%20Ericson&rawcontinue=1&format=xml
16tor aug 27 16:16:42 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A78.70.156.204&rawcontinue=1&format=xml
17tor aug 27 16:15:47 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Bett&rawcontinue=1&format=xml
18tor aug 27 16:15:47 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
19tor aug 27 16:15:47 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Bett&rawcontinue=1&format=xml
20tor aug 27 16:15:47 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
21tor aug 27 16:15:36 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
22tor aug 27 16:15:36 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
23tor aug 27 16:15:36 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417397&rvdiffto=prev&titles=Bett&rawcontinue=1&format=xml
24tor aug 27 16:15:36 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
25tor aug 27 16:15:36 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417397&rvdiffto=prev&titles=Bett&rawcontinue=1&format=xml
26tor aug 27 16:15:36 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
27tor aug 27 16:15:32 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Pessoabett&rawcontinue=1&format=xml
28tor aug 27 16:15:32 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
29tor aug 27 16:15:32 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Pessoabett&rawcontinue=1&format=xml
30tor aug 27 16:15:32 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
31tor aug 27 16:15:18 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
32tor aug 27 16:15:18 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417395&rvdiffto=prev&titles=Pessoabett&rawcontinue=1&format=xml
33tor aug 27 16:15:18 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
34tor aug 27 16:15:18 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
35tor aug 27 16:15:18 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417395&rvdiffto=prev&titles=Pessoabett&rawcontinue=1&format=xml
36tor aug 27 16:15:18 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
37tor aug 27 16:15:08 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
38tor aug 27 16:15:08 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Bett&rawcontinue=1&format=xml
39tor aug 27 16:15:08 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Bett&rawcontinue=1&format=xml
40tor aug 27 16:15:08 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=Munken2002&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
41tor aug 27 16:15:05 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Greta%20Ericson&rawcontinue=1&format=xml
42tor aug 27 16:15:05 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=78.70.156.204&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
43tor aug 27 16:15:04 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Greta%20Ericson&rawcontinue=1&format=xml
44tor aug 27 16:15:04 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=78.70.156.204&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
45tor aug 27 16:14:10 2015 DEBUG[1]: Invalid date: uppmärksamhet och
46tor aug 27 16:14:10 2015 DEBUG[1]: Invalid date: va? /[[Användare:Julle|Julle]]
47tor aug 27 16:14:10 2015 DEBUG[1]: Invalid date: men insatserna
48tor aug 27 16:14:10 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417390&rvdiffto=prev&titles=Greta%20Ericson&rawcontinue=1&format=xml
49tor aug 27 16:14:10 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A78.70.156.204&rawcontinue=1&format=xml
50tor aug 27 16:14:10 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417390&rvdiffto=prev&titles=Greta%20Ericson&rawcontinue=1&format=xml
51tor aug 27 16:14:10 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A78.70.156.204&rawcontinue=1&format=xml
52tor aug 27 16:14:04 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
53tor aug 27 16:14:04 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417388&rvdiffto=prev&titles=Bett&rawcontinue=1&format=xml
54tor aug 27 16:14:04 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
55tor aug 27 16:14:04 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=users&usprop=blockinfo%7Cgroups%7Ceditcount%7Cregistration&ususers=Munken2002&rawcontinue=1&format=xml
56tor aug 27 16:14:04 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cuser%7Ctimestamp%7Ccomment&rvlimit=1&rvstartid=30417388&rvdiffto=prev&titles=Bett&rawcontinue=1&format=xml
57tor aug 27 16:14:04 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3AMunken2002&rawcontinue=1&format=xml
58tor aug 27 16:13:55 2015 Successfully delivered message on svwiki to: 2.68.184.207
59tor aug 27 16:13:55 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=edit&format=xml&assert=user
60tor aug 27 16:13:54 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=edit&format=xml&assert=user
61tor aug 27 16:13:54 2015 DEBUG[2]: Message to 2.68.184.207 with parameters: &createonly=1
62tor aug 27 16:13:54 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A2.68.184.207&rawcontinue=1&format=xml
63tor aug 27 16:13:54 2015 DEBUG[1]: Sending message to user 2.68.184.207
64tor aug 27 16:13:54 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvlimit=1&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&titles=Anv%C3%A4ndardiskussion%3A2.68.184.207&rawcontinue=1&format=xml
65tor aug 27 16:13:42 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Lena%20Nyman&rawcontinue=1&format=xml
66tor aug 27 16:13:42 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=2.68.184.207&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
67tor aug 27 16:13:42 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Lena%20Nyman&rawcontinue=1&format=xml
68tor aug 27 16:13:42 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=2.68.184.207&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
69tor aug 27 16:13:41 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Robertsfors&rawcontinue=1&format=xml
70tor aug 27 16:13:41 2015 DEBUG[6]: Finished request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=82.209.165.178&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml
71tor aug 27 16:13:41 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&prop=revisions&rvprop=ids%7Cflags%7Ctimestamp%7Cuser%7Cuserid%7Csize%7Csha1%7Ccomment&rvlimit=50&titles=Robertsfors&rawcontinue=1&format=xml
72tor aug 27 16:13:41 2015 DEBUG[6]: Processing api request https://sv.wikipedia.org/w/api.php?action=query&list=usercontribs&ucuser=82.209.165.178&ucprop=flags%7Ccomment%7Ctimestamp%7Ctitle%7Cids%7Csize&uclimit=20&rawcontinue=1&format=xml

Logs from --qd would be more useful here