Version: 5.6

Looks to be caused by {fb5d6e3}

Some of my bot tasks cannot function correctly with this occurring, so I've cloned version 5.5 instead of using the shared stable on Toolforge.

Seem that interwikiap does not always contains foreign MediaWiki sites but also other content like for phabricator/bugzilla or iarchive in this case. In this case it does not make any sense to retry to get any json result. Is there any easy way to find out whether a interiki table entry has a MediaWiki as target?

• https://www.mediawiki.org/wiki/API:Siteinfo#Interwikimap
• https://www.mediawiki.org/wiki/Manual:Interwiki_table
• https://www.mediawiki.org/wiki/Special:Interwiki

In T272911#6776440, @Xqt wrote:

Seem that interwikiap does not always contains foreign MediaWiki sites but also other content like for phabricator/bugzilla or iarchive in this case. In this case it does not make any sense to retry to get any json result. Is there any easy way to find out whether a interiki table entry has a MediaWiki as target?

Not that I know of. I was getting the same issue for MediaWiki sites like orthodoxwiki and wikiasite.

Setting -max_retries:1 as global option or setting it in user-config.py will force giving up faster; but it does not solve the underlying problem. I guess Status code is reported as 200 now after changing to requests.Response result of comms.http.request()?

In T272911#6776696, @Xqt wrote:

Setting -max_retries:1 as global option or setting it in user-config.py will force giving up faster; but it does not solve the underlying problem. I guess Status code is reported as 200 now after changing to requests.Response result of comms.http.request()?

Ah, no it's 404:

>>> import pywikibot as py
>>> s = py.Site()
>>> py.config.max_retries = 1
>>> ia = s.interwiki('iarchive')
>>> ia
APISite("iarchive", "iarchive")
>>> ia.siteinfo['namespace']
WARNING: Http response status 404
WARNING: Non-JSON response received from server iarchive:iarchive; the server may be down.
Status code:404
WARNING: Waiting 5.0 seconds before retrying.
WARNING: Http response status 404
WARNING: Non-JSON response received from server iarchive:iarchive; the server may be down.
Status code:404
Traceback (most recent call last):
  File "<pyshell#6>", line 1, in <module>
    ia.siteinfo['namespace']
  File "C:\pwb\GIT\core\pywikibot\site\_siteinfo.py", line 253, in __getitem__
    return self.get(key, False)  # caches and doesn't force it
  File "C:\pwb\GIT\core\pywikibot\site\_siteinfo.py", line 301, in get
    preloaded = self._get_general(key, expiry)
  File "C:\pwb\GIT\core\pywikibot\site\_siteinfo.py", line 241, in _get_general
    default_info = self._get_siteinfo(props, expiry)
  File "C:\pwb\GIT\core\pywikibot\site\_siteinfo.py", line 165, in _get_siteinfo
    data = request.submit()
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 2053, in submit
    self._data = super().submit()
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1803, in submit
    result = self._json_loads(response)
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1600, in _json_loads
    self.wait()
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1920, in wait
    raise TimeoutError('Maximum retries attempted without success.')
pywikibot.exceptions.TimeoutError: Maximum retries attempted without success.

>>>

Change 663784 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [IMPR] Print additional informations if Non-JSON response received from server

https://gerrit.wikimedia.org/r/663784

@JAnD: I checked your command line from T276660 and it worked for me as expected. Are you able to review my last commit and confirm the right behaviour?

Change 663784 merged by jenkins-bot:
[pywikibot/core@master] [IMPR] Raise an exception response is Non-JSON and site is AutoFamily

https://gerrit.wikimedia.org/r/663784

In T272911#6912011, @Xqt wrote:

@JAnD: I checked your command line from T276660 and it worked for me as expected. Are you able to review my last commit and confirm the right behaviour?

It works now.:-)