Page MenuHomePhabricator

"UnicodeDecodeError: 'ascii' codec can't decode byte 0xff in position 2361: ordinal not in range(128)" on flickrripper
Closed, DuplicatePublic

Description

1C:\Users\Jonatan> C:\Python27\python.exe C:\Users\Jonatan\Desktop\pywikibot\core2\pwb.py flickrripper -user_id:35142635@N05 -removecategories -addcategory:Photographs_by_S._Rae]][[Category:Photos_of_species_uploaded_by_Josve05a]][[Category:Files_uploaded_by_Josve05a_(S._Rae) -autonomous -putthrottle:0 -socket_timeout:120 -start_id:8699156516
2WARNING: Configuration variable 'absolute_import' is defined but unknown.
3Misspelled?
4WARNING: Configuration variable 'db_port' is defined but unknown.
5Misspelled?
6WARNING: Configuration variable 'weblink_dead_days' is defined but unknown.
7Misspelled?
8WARNING: Configuration variable 'panoramio' is defined but unknown.
9Misspelled?
108699156516
11Found duplicate image at Megascolia maculata - Flickr - S. Rae (3).jpg
128699156494
13Found duplicate image at Megascolia maculata.jpg
148698033823
15Found duplicate image at Megascolia maculata2.jpg
168699157614
17WARNING: url as string is deprecated. Use an iterable instead.
18The suggested description is:
19== {{int:filedesc}} ==
20{{Information
21|Description=Argaka, Cyprus
22|Source=[https://www.flickr.com/photos/35142635@N05/8699157614/ Sphex flavipennis - a humungous wasp]
23|Date=2013-04-30 06:01
24|Author=[https://www.flickr.com/people/35142635@N05 S. Rae] from Scotland, UK
25|Permission=
26|other_versions=
27}}
28{{Location dec|35.076861|32.495627|source:Flickr}}
29
30=={{int:license-header}}==
31{{cc-by-2.0}}
32{{flickrreview}}
33[[Category:Photographs_by_S._Rae]][[Category:Photos_of_species_uploaded_by_Josve05a]][[Category:Files_uploaded_by_Josve05a_(S._Rae)]]
34
35Uploading file to commons:commons via API...
36Reading file https://farm9.staticflickr.com/8557/8699157614_86c9b29599_o.jpg
37ERROR: Traceback (most recent call last):
38 File "C:\Users\Jonatan\Desktop\pywikibot\core2\pywikibot\data\api.py", line 1558, in submit
39 body=body, headers=headers)
40 File "C:\Users\Jonatan\Desktop\pywikibot\core2\pywikibot\tools\__init__.py", line 1105, in wrapper
41 return obj(*__args, **__kw)
42 File "C:\Users\Jonatan\Desktop\pywikibot\core2\pywikibot\comms\http.py", line 279, in request
43 r = fetch(baseuri, method, body, headers, **kwargs)
44 File "C:\Users\Jonatan\Desktop\pywikibot\core2\pywikibot\comms\http.py", line 381, in fetch
45 error_handling_callback(request)
46 File "C:\Users\Jonatan\Desktop\pywikibot\core2\pywikibot\comms\http.py", line 297, in error_handling_callback
47 raise request.data
48UnicodeDecodeError: 'ascii' codec can't decode byte 0xff in position 2361: ordinal not in range(128)
49
50WARNING: Waiting 5 seconds before retrying.

Event Timeline

1C:\Users\Jonatan>C:\Python27\python.exe C:\Users\Jonatan\Desktop\pywikibot\core2\pwb.py version
2WARNING: Configuration variable 'absolute_import' is defined but unknown.
3Misspelled?
4WARNING: Configuration variable 'db_port' is defined but unknown.
5Misspelled?
6WARNING: Configuration variable 'weblink_dead_days' is defined but unknown.
7Misspelled?
8WARNING: Configuration variable 'panoramio' is defined but unknown.
9Misspelled?
10Pywikibot: [https] r-pywikibot-core.git (59ade9b, g2, 2016/10/13, 08:38:11, n/a)
11Release version: 2.0rc5
12httplib2 version: 0.9.2
13 cacerts: C:\Python27\lib\site-packages\httplib2\cacerts.txt
14 certificate test: ok
15Python: 2.7.11 (v2.7.11:6d1b6a68f775, Dec 5 2015, 20:32:19) [MSC v.1500 32 bit (Intel)]
16 unicode test: ok
17PYWIKIBOT2_DIR: Not set
18PYWIKIBOT2_DIR_PWB: C:\Users\Jonatan\Desktop\pywikibot\core2
19PYWIKIBOT2_NO_USER_CONFIG: Not set
20Config base dir: C:\Users\Jonatan\Desktop\pywikibot\core2
21Usernames for family "wikipedia":
22 nl: Josve05a (no sysop configured)
23 sv: Josve05a (no sysop configured)
24Usernames for family "commons":
25 commons: Josve05a (no sysop configured)
26Usernames for family "wikidata":
27 wikidata: Josve05a (no sysop configured)

Xqt triaged this task as High priority.Oct 16 2016, 12:19 PM
Xqt removed a project: Pywikibot-Scripts.
Xqt subscribed.

This is a 2.0 issue. Might be it works for master branch but I haven't tested it.

I haven't tried using flickrripper.py for 3.0 since I started, due to it not being migrated for that version...

I think this might just be another version of T99366: error with httplib2 and unicode_literals: UnicodeDecodeError: 'ascii' codec can't decode byte 0xff in position 1872: ordinal not in range(128). The solution is fixing the bytes/unicode mess in our comms layer, but my last attempt at that went no-where.

Try using master instead of 2.0? Note that this is about the pywikibot version, not the python version.