Steps to Reproduce:
Collect a list of pages containing unicode text
Run the following command (replace filename and fix tag name from user-fixes.py as per your configuration)
pwb.py replace -fix:vebug1 -file:pages-ve-bug.txt
Actual Results:
crashes with the following log after processing some pages
Example crash log
>>> బొరుగులు <<<
@@ -10 +10 @@
- #[[జల్లెడ]] పట్టి [[ఇసుక]]<nowiki/>ని తీసివెయ్యండి
+ #[[జల్లెడ]] పట్టి [[ఇసుక]]ని తీసివెయ్యండి
Do you want to accept these changes? ([y]es, [N]o, [e]dit original, edit
[l]atest, open in [b]rowser, [a]ll, [q]uit):a
Traceback (most recent call last):
File "/srv/paws/pwb/pwb.py", line 250, in <module>
if not main():
File "/srv/paws/pwb/pwb.py", line 243, in main
run_python_file(filename, [filename] + args, argvu, file_package)
File "/srv/paws/pwb/pwb.py", line 95, in run_python_file
main_mod.__dict__)
File "replace.py", line 1191, in <module>
main()
File "replace.py", line 1182, in main
bot.run()
File "replace.py", line 773, in run
default='N')
File "/srv/paws/pwb/pywikibot/bot.py", line 502, in input_choice
automatic_quit=automatic_quit, force=force)
File "/srv/paws/pwb/pywikibot/userinterfaces/terminal_interface_base.py", line 381, in input_choice
answer = self.input(output) or default
File "/srv/paws/pwb/pywikibot/userinterfaces/terminal_interface_base.py", line 293, in input
text = self._input_reraise_cntl_c(password)
File "/srv/paws/pwb/pywikibot/userinterfaces/terminal_interface_base.py", line 309, in _input_reraise_cntl_c
text = self._raw_input()
File "/srv/paws/pwb/pywikibot/userinterfaces/terminal_interface_base.py", line 248, in _raw_input
return input()
UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 0-1: invalid continuation byte
CRITICAL: Exiting due to uncaught exception <class 'UnicodeDecodeError'>Trying to run the page individually sometimes works
Expected Results:
All pages processed without error