Page MenuHomePhabricator
Create Task
Maniphest T57240

add_text.py crashes for some uses of -cat
Closed, ResolvedPublic
Actions

Description

Originally from: http://sourceforge.net/p/pywikipediabot/bugs/1329/
Reported by: dabzzz
Created on: 2011-08-05 19:01:42
Subject: add_text.py crashes for some uses of -cat
Assigned to: bewareofdoug
Original description:
Crashes without further information; works correct on category without umlaut in it. Happens on my bot account at de.hardware-wiki.org

$ python add_text.py -cat -text:someveryimportantmessage -up -verbose
Config.py
- base_dir:  /home/bzzz/.pywikipedia
- done.
Pywikipediabot [http] trunk/pywikipedia (r9430, 2011/08/04, 08:15:02)
Python 2.7.1+ (r271:86832, Apr 11 2011, 18:13:53) 
[GCC 4.5.2]
Please enter the category name: Festplatten nach Größe
Getting [[Kategorie:Festplatten nach Größe]]... <--exists, has subcategories and is categorized
==== API action:query ====
cmprop: title|ids|sortkey|timestamp
list: categorymembers
cmlimit: 500
cmtitle: Kategorie:Festplatten nach Größe
----------------
Requesting API query from HardwareWiki:de
[End]

Same happens if the working category is given via -cat:Festplatten_nach_Größe or within "".

pywikipediabot is at latest svn version (9430, simplejson 242), working on Kubuntu 11.04 Natty with 2.6.38-10-generic kernel;  python version.py yields:
Pywikipedia [http] trunk/pywikipedia (r9430, 2011/08/04, 08:15:02)
Python 2.7.1+ (r271:86832, Apr 11 2011, 18:13:53) 
[GCC 4.5.2]
config-settings:
use_api = True
use_api_login = True
unicode test: ok

Version: unspecified
Severity: normal
See Also:
https://sourceforge.net/p/pywikipediabot/bugs/1329

Details

Reference
bz55240

Related Objects

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:29 AM
• bzimport added a project: Pywikibot-category.py.
• bzimport set Reference to bz55240.
• bzimport added a subscriber: Unknown Object (????).
Legoktm created this task.Oct 5 2013, 4:49 AM
Legoktm added a comment.Oct 5 2013, 4:49 AM

The problem is not with umlauts per se, I have tested \(r9811\) on botwiki and de.hardware-wiki.org and can use both:

python add\_text.py -cat -text:someevenmoreimportantmessage -up -v
with the category: Für\_Prüfung

and

python add\_text.py -cat:Für\_Prüfung -text:someveryimportantmessage -up -v

without difficulty in my bot's userspace

But I can replicate the above termination using the same cat on that wiki.

I note that the category has 40 subcats and several hundred pages. I also note that the above cat also contains an esszet.

Reducing to priority 3 as this is the only reported instance and it would appear to have a relatively minor impact \(replace.py should work in lieu of add\_text.py\)

Assigning to self to investigate further.

It would be useful if the reporter could give more information on examples of cats where this worked \(eg. did it work with esszet, did it work on similar sized cats, etc.\)

Legoktm added a comment.Oct 5 2013, 4:49 AM
  • labels: 745454 --> category
  • milestone: --> confirmed
  • priority: 5 --> 3
  • assigned_to: nobody --> bewareofdoug
  • summary: add_text.py crashes on usage with umlaut --> add_text.py crashes for some uses of -cat
Legoktm added a comment.Oct 5 2013, 4:49 AM

Well, the ß may be part of the problem. Same problem exists on cats like "Kategorie:SSDs nach Größe" \(42 sub categories\) or "Gehäuse nach Größe‏‎" \(21 sc\).

However, "GPU-Kühler nach Kompatibilität" \(155 sc\) also fails, but has no eszett in it. "Kühler für AMD Sockel AM3‏‎" \(97 sc\) works...

Ladsgroup added a project: TestMe.May 17 2015, 8:44 PM
Ladsgroup set Security to None.
Dvorapa edited projects, added Pywikibot; removed Pywikibot-category.py.Dec 4 2017, 4:08 PM
Restricted Application added subscribers: Cyberpower678, TerraCodes. · View Herald TranscriptDec 4 2017, 4:08 PM
Dvorapa added a project: Pywikibot-Scripts.Dec 4 2017, 4:08 PM
Kizule subscribed.EditedJan 12 2018, 12:19 AM

I tested using master version of pywikibot downloaded from gerrit and I have not problems with this..

  1. I runned pywiki on my wiki in localhost with command
python add_text.py -cat -text:someveryimportantmessage -up -verbose
  1. When he requested category I added Festplatten nach Größe
  2. And he changed without problems.
Kizule closed this task as Resolved.Jan 12 2018, 3:42 PM
Aklapper updated the task description. (Show Details)Jan 12 2018, 3:58 PM
Aklapper reopened this task as Open.Jan 12 2018, 4:00 PM
Aklapper subscribed.

@Zoranzoki21: What was your exact output for the API action:query? See the task description.

Kizule closed this task as Resolved.Jan 12 2018, 4:19 PM
In T57240#3896969, @Aklapper wrote:

@Zoranzoki21: What was your exact output for the API action:query? See the task description.

C:\Users\ZoranD\Desktop\pywikibot>python pwb.py add_text -page:User:Zoranzoki21/
????? -text:someveryimportantmessage -up -verbose
Pywikibot rede13695872939f4cedbb139bd03ead318ef64cb
Python 3.6.4 (v3.6.4:d48eceb, Dec 19 2017, 06:04:45) [MSC v.1900 32 bit (Intel)]

Loading Корисник:Zoranzoki21/песак...
Found 2 localhost:sr processes running, including this one.


>>> Корисник:Zoranzoki21/песак <<<
@@ -0,0 +1 @@
+ someveryimportantmessage

Do you want to accept these changes? ([y]es, [N]o, [a]ll, open in [b]rowser, [q]
uit): y
Page [[Корисник:Zoranzoki21/песак]] saved
Dropped throttle(s).
Closing network session.
Network session closed.

C:\Users\ZoranD\Desktop\pywikibot>

It is all

Dvorapa updated the task description. (Show Details)Jan 12 2018, 5:24 PM
Dvorapa reopened this task as Open.EditedJan 12 2018, 5:27 PM
Dvorapa subscribed.

The issue was found on Python 2.7.1, but tested on Python 3.6.4, therefore the test wasn't performed under the same (or at least similar) conditions

Kizule added a comment.Jan 12 2018, 7:11 PM
In T57240#3897262, @Dvorapa wrote:

The issue was found on Python 2.7.1, but tested on Python 3.6.4, therefore the test wasn't performed under the same (or at least similar) conditions

Support will be soon abolished

Dvorapa added a comment.Jan 12 2018, 7:21 PM

Not really soon. Python 2.7 will be supported for at least two years since now and then it may be lengthened

Kizule added a comment.Jan 12 2018, 7:33 PM
In T57240#3897610, @Dvorapa wrote:

Not really soon. Python 2.7 will be supported for at least two years since now and then it may be lengthened

I talk about pywiki

Dvorapa added a comment.Jan 12 2018, 7:42 PM

pywikibot will support Python 2.7 at least next two years, the same length as Python community itself

Dvorapa closed this task as Resolved.Jan 14 2018, 2:01 PM

Hardware wiki is closed, similar categories in de.wiki works as expected (tried 20 cats with all combinations above in py2 and py3), please reopen if this issue pops up once more

Kizule mentioned this in T178988: [beginner] [recurring] Retest 2 old open bug reports in Wikimedia's issue tracker.Jan 14 2018, 2:04 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits