Page MenuHomePhabricator

Problem with chinese character
Closed, DeclinedPublic

Description

Originally from: http://sourceforge.net/p/pywikipediabot/bugs/1327/
Reported by: jandudik
Created on: 2011-08-03 11:31:41
Subject: Problem with chinese character
Original description:
Bot removes interwiki, which have incorrect character at the end.
But mediawiki translates this character correctly

http://pl.wikipedia.org/w/index.php?title=Wios%C5%82onos\_ameryka%C5%84ski&action=historysubmit&diff=27500418&oldid=27491213


Version: compat-(1.0)
Severity: minor
See Also:
https://sourceforge.net/p/pywikipediabot/bugs/1327

Details

Reference
bz55241

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 2:29 AM
bzimport set Reference to bz55241.

Is it still valid? I didn't try to reproduce it

Probably obsolete with Wikidata.

The problem bot edit is here:
https://pl.wikipedia.org/w/index.php?title=Wios%C5%82onos_ameryka%C5%84ski&diff=prev&oldid=27482496

And the bot removed '[[zh:匙吻鲟]]' from '[[pl:Wiosłonos amerykański]]' with an edit summary of : (r2.5.2) (robot usuwa zh:匙吻鲟)

It appears from the interwiki code that 'r2.5.2' is the python version.

Was this 2011 edit done with compat or core?

Haven't read through the code yet, but the following seems to suggest that interwiki.py is likely to have the bug:

import pywikibot
pywikibot.Page(pywikibot.Site("zh", "wikipedia"), u"匙吻鲟").exists()

False

pywikibot.Page(pywikibot.Site("zh", "wikipedia"), u"匙吻鱘").exists()

True

Was this 2011 edit done with compat or core?

It is compat for that edit and the reason is that mw is able to redirect different spelling style whereas compat framework is not.

Would it be possible for Site.loadpageinfo() to make use of "converttitles" api parameter?

(In reply to zhuyifei1999 from comment #6)

Would it be possible for Site.loadpageinfo() to make use of "converttitles"
api parameter?

That looks like a good approach. How will you determine if the wiki's content language supports variant conversion?

(In reply to John Mark Vandenberg from comment #7)

(In reply to zhuyifei1999 from comment #6)

Would it be possible for Site.loadpageinfo() to make use of "converttitles"
api parameter?

That looks like a good approach. How will you determine if the wiki's
content language supports variant conversion?

@liangent: ?

I guess always adding that does no harm?

Aklapper lowered the priority of this task from Low to Lowest.Jun 5 2015, 1:41 PM
Aklapper subscribed.

Pywikibot has two versions: Compat and Core. This task was filed about the older version, called Pywikibot-compat, which is not under active development anymore. Hence I'm lowering the priority of this task to reflect the reality. Unfortunately, the Pywikibot team does not have the manpower to retest every single bug report / feature request against the (maintained) Pywikibot code base. Furthermore, the code base of Pywikibot-Compat has changed a lot compared to the code base of Pywikibot-Core so there is a chance that the problem described in this task might not exist anymore. Please help: Unfortunately manpower is limited and does not allow testing every single reported task again. If you have time and interest in Pywikibot, please upgrade to Pywikibot-Core and add a comment to this task if the problem in this task still happens in Pywikibot-Core (or directly edit the task by removing the Pywikibot-compat project and adding the Pywikibot project to this task). To learn more about Pywikibot and to get involved in its development, please check out https://www.mediawiki.org/wiki/Manual:Pywikibot/Development Thank you for your understanding.

zhuyifei1999 raised the priority of this task from Lowest to Low.Jun 6 2015, 7:44 AM

This appears to be not fixed in core:

tools.yifeibot@tools-bastion-02:~/pywikibot$ git status
On branch master
Your branch is up-to-date with 'origin/master'.

Untracked files:
  (use "git add <file>..." to include in what will be committed)

<a list of files removed>

nothing added to commit but untracked files present (use "git add" to track)
tools.yifeibot@tools-bastion-02:~/pywikibot$ python pwb.py shell
Welcome to the Pywikibot interactive shell!
>>> import pywikibot
>>> pywikibot.Page(pywikibot.Site("zh", "wikipedia"), u"匙吻鲟").exists()
False
>>> pywikibot.Page(pywikibot.Site("zh", "wikipedia"), u"匙吻鱘").exists()
True

I'll create a ticket for that as a blocker for this task.

jayvdb lowered the priority of this task from Low to Lowest.Jun 6 2015, 9:25 AM

I guess the original problem has now moved to Wikidata?

Q827142 has only the canonical page/title for 匙吻鱘, and it does not permit me to save "匙吻鲟" as the interwiki entry for zh.wp.

I've set this as Lowest Priority as I dont believe it has a large impact on wiktionary where interwiki links are between exact same titled pages, and the rest of Wikimedia uses Wikidata now.

However the underlying problem is really quite serious, so the priority of T101597 is raised to High. Once we fix Page/Link in the subclass, the interwiki problem will hopefully also be solved, but I dont have a lot of confidence that it will magically disappear from interwiki.py

T101597 has been created to solve it (mainly for core). I guess compat will not be changed anymore for that behaviour request.