Page MenuHomePhabricator
Create Task
Maniphest T143316

Wikipedia August dump MySQL syntax issue
Closed, DeclinedPublic
Actions

Description

Hi,

we were trying to run Mediawiki Dumper and we got that:

ERROR 1064 (42000) at line 127478: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''{{Orphan|date=April 2014}}\n\nThe \'\'\'lung float test\'\'\', also called the ' at line 1

do you know how to get the issue fixed?

This is the command we ran:

java -server -classpath /data/servers/data_load/lib/commons-compress.jar:/data/servers/data_load/lib/mwdumper.jar org.mediawiki.dumper.Dumper --format=sql:1.5 /data/servers/data_load/en/20160801/enwiki-20160801-pages-articles.xml.bz2 | /usr/bin/mysql --max_allowed_packet=1G --default-character-set=utf8 --force -h 127.0.0.1 -uXXXXXXX -pXXXXXXX -P 3306 -D wikimirror_en

mysql version we are using is… 5.6.22

Event Timeline

DianaArq created this task.Aug 18 2016, 2:02 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 18 2016, 2:02 PM
DianaArq updated the task description. (Show Details)Aug 18 2016, 2:03 PM
DianaArq updated the task description. (Show Details)Aug 18 2016, 3:13 PM
ArielGlenn subscribed.Aug 22 2016, 1:46 PM

Can you try to narrow it down some to a small number of pages?

So first ,which pages-articles subfile (1...27) causes the error, and then if at all possible grab a few pages before and after the problematic one and verify that you still get the error, and attach that much smaller test file to this task so we can play? That would cut down the test time a lot.

ArielGlenn added a comment.Aug 22 2016, 1:48 PM

After that it would be great if you could attach the raw mwdumper output from that small (3-4 pages) test file to this task also and then we can see what's going on.

ArielGlenn added a comment.Sep 12 2016, 11:56 AM

Any update here?

ArielGlenn moved this task from Backlog to Blocked on the Datasets-General-or-Unknown board.Dec 15 2016, 8:00 PM
ArielGlenn closed this task as Declined.Dec 19 2016, 2:23 PM

We really need more information to be able to proceed on this ticket. It's been a few months without a reply, so I'm hoping that means the problem is resolved. For that reason I'm closing it as 'declined'. If not and you want to follow up, just re-open this ticket and add more information to it. Thanks!

ArielGlenn moved this task from Blocked to Done on the Datasets-General-or-Unknown board.Feb 10 2017, 2:45 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits