Eventstreams fails with sseclient 0.0.24 with "WARNING: Could not load json data from {...}" due to "Unterminated string..." or "Expecting value..."
The same in 0.0.23. Probably Python 2.7 and 3.4 works but it is not tested.
eventstreams_tests are passing for 0.0.22 and 0.0.24 therefore this problem should become part of the test suite
See below:
C:\pwb\GIT\core>pwb archive/script_wui -simulate
> main
> __init__
* Initialization of bot
WARNING: C:\pwb\GIT\core\pywikibot\comms\eventstreams.py:347: DeprecationWarning
: stream argument of pywikibot.comms.eventstreams.EventStreams.__init__ is depre
cated; use streams instead.
stream = EventStreams(stream='recentchange', site=site)
** Redirecting Lua print in order to catch it
** Pre-loading all relevant page contents
** Starting crontab background timer thread
> on_timer
> do_check_CronJobs
WARNING: .\scripts\archive\script_wui.py:215: FutureWarning: Version 0.22.0+ of
crontab will use datetime.utcnow() and
datetime.utcfromtimestamp() instead of datetime.now() and
datetime.fromtimestamp() as was previous. This had been a bug, which will be
remedied. If you would like to keep the *old* behavior:
`ct.next(..., default_utc=False)` . If you want to use the new behavior *now*:
`ct.next(..., default_utc=True)`. If you pass a datetime object with a tzinfo
attribute that is not None, timezones will *just work* to the best of their
ability. There are tests...
now - datetime.timedelta(microseconds=1))
> start
> on_event
WARNING: Empty message found.
> on_event
WARNING: Could not load json data from
{"bot":true,"comment":"Renamed prefixcat > prefix cat","id":65549847,"length":{"
new":22,"old":21},"meta":{"domain":"en.wiktionary.org","dt":"2019-05-09T13:10:36
+00:00","id":"d608cd28-725b-11e9-85b1-b083fecf0568","request_id":"XNQmzApAMEYAAC
ct27cAAACS","schema_uri":"mediawiki/recentchange/2","topic":"eqiad.mediawiki.rec
entchange","uri":"https://en.wiktionary.org/wiki/Category:French_words_prefixed_
with_podo-","partition":0,"offset":1581312525},"minor":true,"namespace":14,"pars
edcomment":"Renamed prefixcat > prefix cat","patrolled":true,"revision":{"new
":52779116,"old":27375388},"server_name":"en.wiktionary.org","server_script_path
":"/w","server_url":"https://en.wiktionary.org","timestamp":1557407436,"title":"
Ca
Unterminated string starting at: line 1 column 720 (char 719)
WARNING: Could not load json data from
{"bot":false,"comment":"/* wbcreateclaim-create:1| */ [[Property:P921]]: [[Q1344
835]], #quickstatements; [[:toollabs:quickstatements/#/batch/12343|batch #12343]
] by [[User:Daniel Mietchen|]]","id":974236230,"length":{"new":20971,"old":20538
},"meta":{"domain":"www.wikidata.org","dt":"2019-05-09T13:10:37+00:00","id":"d60
8cb32-725b-11e9-ae31-14187761340f","request_id":"XNQmzApAAEsAABPTiPQAAABD","sche
ma_uri":"mediawiki/recentchange/2","topic":"eqiad.mediawiki.recentchange","uri":
"https://www.wikidata.org/wiki/Q40777649","partition":0,"offset":1581312544},"mi
nor":false,"namespace":0,"parsedcomment":"<span dir=\"auto\"><span class=\"auto
comment\">Created claim: </span></span> <a href=\"/wiki/Property:P921\" title=\"
Property:P921\">Property:P921</a>: <a href=\"/wiki/Q1344835\" title=\"Q1344835\"
>Q1344835</a>, #quickstatements; <a href=\"https://tools.wmflabs.org/quickstatem
ents/#.2Fbatch.2F12343\" class=\"extiw\" title=\"toollabs:quickstatements/\">bat
ch #12343</a> by <a href=\"/wiki/User:Daniel_Mietchen\" title=\"User:Daniel Miet
chen\">User:Daniel Mietchen</a>","patrolled":true,"revision":{"new":937459355,"o
ld":865678082},"server_name":"www.wikidata.org","server_script_path":
Expecting value: line 1 column 1190 (char 1189)
WARNING: Could not load json data from
{"bot":false,"comment":"","id":1217424981,"log_action":"overwrite","log_action_c
omment":"uploaded a new version of File:LL-Q188 (deu)-Sebastian Wallroth-Bildsch
irme.wav","log_id":281363170,"log_params":{"img_sha1":"2a5fhvbvcxfm13kon3v3kmve1
q16z3k","img_timestamp":"20190509131034"},"log_type":"upload","meta":{"domain":"
commons.wikimedia.org","dt":"2019-05-09T13:10:34+00:00","id":"d6a16823-725b-11e9
-8fd6-b083fecf0dc3","request_id":"XNQmxgpAMDkAACLYNbAAAAEV","sc
Unterminated string starting at: line 1 column 461 (char 460)
WARNING: Could not load json data from
{"bot":false,"comment":"/* Рейтинг */","id":369676751,"length":{"new":12461,"old
":10701},"meta":{"domain":"ru.wikipedia.org","dt":"2019-05-09T13:10:38+00:00","i
d":"d6a16b3c-725b-11e9-ba5e-b083fecf0e3f","request_id":"XNQmzgpAMEoAAAUyJIgAAAAH
","schema_uri":"mediawiki/recentchange/2","topic":"eqiad.mediawiki.recentchange"
,"uri":"https://ru.wikipedia.org/wiki/%D0%A1%D0%BF%D0%B8%D1%81%D0%BE%D0%BA_%D0%B
A%D1%80%D1%83%D0%BF%D0%BD%D0%B5%D0%B9%D1%88%D0%B8%D1%85_%D0%BA%D0%BE%D0%BC%D0%BF
%D0%B0%D0%BD%D0%B8%D0%B9_%D0%9A%D0%B8%D1%82%D0%B0%D1%8F_%D0%BF%D0%BE_%D0%B2%D0%B
5%D1%80%D1%81%D0%B8%D0%B8_Forbes_(2019)","partition":0,"offset":1581312564},"min
or":false,"namespace":0,"parsedcomment":"<span dir=\"auto\"><span class=\"autoco
mment\"><a href=\"/wiki/%D0%A1%D0%BF%D0%B8%D1%81%D0%BE%D0%BA_%D0%BA%D1%80%D1%83%
D0%BF%D0%BD%D0%B5%D0%B9%D1%88%D0%B8%D1%85_%D0%BA%D0%BE%D0%BC%D0%BF%D0%B0%D0%BD%D
0%B8%D0%B9_%D0%9A%D0%B8%D1%82%D0%B0%D1%8F_%D0%BF%D0%BE_%D0%B2%D0%B5%D1%80%D1%81%
D0%B8%D0%B8_Forbes_(2019)#Рейтинг\" title=\"Список крупнейших компаний Китая по
версии Forbes (2019)\">→Рейтинг</a></span></span>","revision":{"new":99682356,"
old":99682026},"server_name":"ru.wikipedia.org","server_script_path":"/w","serve
r_url":"https://ru.wikipedia.org","timestamp":1557407438,"title":"Список крупн
Unterminated string starting at: line 1 column 1266 (char 1265)
> on_event
WARNING: Could not load json data from
{"bot":true,"comment":"/* wbremoveclaims-remove:1| */ [[Property:P2093]]: Christ
ine Mannhalter, #quickstatements; [[:toollabs:editgroups/b/CB/#temporary_batch_1
538582933236|details]]; invoked by sourcemd_batch_processing on behalf of [[User
:Magnus Manske|]] (batch 551)","id":974236239,"length":{"new":50589,"old":51211}
,"meta":{"domain":"www.wikidata.org","dt":"2019-05-09T13:10:37+00:00","id":"d6a1
5da2-725b-11e9-b05c-141877613170","request_id":"XNQmzQpAEDEAAGdUzp4AAAHF","schem
a_uri":"mediawiki/recentchange/2","topic":"eqiad.mediawiki.recentchange","uri":"
https://www.wikidata.org/wiki/Q58955464","partition":0,"offset":1581312571},"min
or":false,"namespace":0,"parsedcomment":"<span dir=\"auto\"><span class=\"autoc
omment\">Removed claim: </span></span> <a href=\"/wiki/Property:P2093\" title=\"
Property:P2093\">Property:P2093</a>: Christine Mannhalter, #quickstatements; <a
href=\"https://tools.wmflabs.org/editgroups/b/CB/#temporary_batch_1538582933236\
" class=\"extiw\" title=\"toollabs:editgroups/b/CB/\">details</a>; invoked by so
urcemd_batch_processing on behalf of <a href=\"/wiki/User:Magnus_Manske\" title=
\"User:Magnus Manske\">User:Magnus Manske</a> (batch 551)","patrolled":true,"rev
ision":{"new":937459366,"old":937459332},"server_name":"www.wikidata.org","serve
r_script_path":"/w","server_url":"https://www.wikidata.org","timestam
Unterminated string starting at: line 1 column 1341 (char 1340)