Reindexing attempt
ArchivedPublic
Actions

Authored by TJones on May 5 2025, 9:08 PM.

Project Tags

None

Referenced Files

	F59704958: Reindexing attempt
	May 5 2025, 9:09 PM

	F59704930: Reindexing attempt
	May 5 2025, 9:08 PM

Subscribers

EBernhardson

	$ mkdir ~/cirrus-reindex.$(date '+%Y%m%d')
	$ cd !$
	$ python3 -m venv --system-site-packages venv
	$ venv/bin/pip install cirrus-reindexer \
	--index-url https://gitlab.wikimedia.org/api/v4/groups/repos%2Fsearch-platform/-/packages/pypi/simple
	$ screen
	$ source venv/bin/activate
	(venv) tjones@deploy1003:~/cirrus-reindex.20250505$ python3 -m cirrus_reindexer.reindex_all --cirrus-cluster eqiad --dbnames cswikibooks cswikivoyage
	Reindexing state stored in: eqiad/state.json
	No state found.
	Execution ended early. Process is likely incomplete.
	Traceback (most recent call last):
	File "/usr/lib/python3/dist-packages/requests/adapters.py", line 439, in send
	resp = conn.urlopen(
	File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 846, in urlopen
	return self.urlopen(
	File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 846, in urlopen
	return self.urlopen(
	File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 846, in urlopen
	return self.urlopen(
	[Previous line repeated 2 more times]
	File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 836, in urlopen
	retries = retries.increment(method, url, response=response, _pool=self)
	File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 574, in increment
	raise MaxRetryError(_pool, url, error or ResponseError(cause))
	urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='noc.wikimedia.org', port=443): Max retries exceeded with url: /wiki.php?wiki=cswikibooks&format=json (Caused by ResponseError('too many 500 error responses'))

	During handling of the above exception, another exception occurred:

	Traceback (most recent call last):
	File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
	return _run_code(code, main_globals, None,
	File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
	exec(code, run_globals)
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_reindexer/reindex_all.py", line 295, in <module>
	sys.exit(entry_point())
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_reindexer/reindex_all.py", line 291, in entry_point
	return main(**post_process_args(dict(vars(args))))
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_reindexer/reindex_all.py", line 254, in main
	for index_alias in CirrusIndexAlias.from_external_states(
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_reindexer/cirrus.py", line 221, in from_external_states
	hostname = noc_client.get_hostname_by_wiki_id(dbname)
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_toolbox/noc_client.py", line 26, in get_hostname_by_wiki_id
	endpoint = self._for_wiki(wiki_id)["wgCanonicalServer"]
	File "/home/tjones/cirrus-reindex.20250505/venv/lib/python3.9/site-packages/cirrus_toolbox/noc_client.py", line 19, in _for_wiki
	resp = self._session.get(
	File "/usr/lib/python3/dist-packages/requests/sessions.py", line 555, in get
	return self.request('GET', url, **kwargs)
	File "/usr/lib/python3/dist-packages/requests/sessions.py", line 542, in request
	resp = self.send(prep, **send_kwargs)
	File "/usr/lib/python3/dist-packages/requests/sessions.py", line 655, in send
	r = adapter.send(request, **kwargs)
	File "/usr/lib/python3/dist-packages/requests/adapters.py", line 507, in send
	raise RetryError(e, request=request)
	requests.exceptions.RetryError: HTTPSConnectionPool(host='noc.wikimedia.org', port=443): Max retries exceeded with url: /wiki.php?wiki=cswikibooks&format=json (Caused by ResponseError('too many 500 error responses'))

Event Timeline

TJones created this paste.May 5 2025, 9:08 PM

TJones edited the content of this paste. (Show Details)

@EBernhardson, any idea why this isn't working?

I think I set everything up correctly. I tried to run it on two small Czech wikis, cswikibooks and cswikivoyage, and I think I have the invocation correct, but it immediately errors out.

This looks like a wider problem, https://noc.wikimedia.org/wiki.php should render an html page in the browser, but instead it's failing out. I'm not really sure who even owns that, maybe release engineering? I'll poke around and file a ticket.

T393415

Thanks, Erik!

TJones archived this paste.May 12 2025, 4:09 PM

Reindexing attemptArchivedPublicActions

Event Timeline

Reindexing attempt
ArchivedPublic
Actions