Maniphest T340388

Bot should detect whether HTTP resource now exists at HTTPS
Open, MediumPublic
Actions

Assigned To

None

Authored By

	JAnD
	Jun 25 2023, 12:00 PM

Project Tags

Referenced Files

None

Subscribers

Description

Diff(s) (if applicable):
https://cs.wikipedia.org/w/index.php?title=Pomn%C3%ADk_padl%C3%BDm_v_1._sv%C4%9Btov%C3%A9_v%C3%A1lce_(He%C5%99ma%C5%88)&curid=1665383&diff=22917135&oldid=22023373

What is happening?:

Sometimes page still exists, but in meantime was chnaged from http to https.

What should happen instead?:

Bot should check https instead of http (and vice versa) and repair url.

Related Objects

Duplicates Merged Here: T341643: http -> https

Event Timeline

JAnD created this task.Jun 25 2023, 12:00 PM

Harej moved this task from Inbox to Backlog: URLs on the InternetArchiveBot board.Jun 29 2023, 7:31 PM

Harej renamed this task from http / https to Bot should detect whether HTTP resource now exists at HTTPS.Jul 19 2023, 8:58 PM

Harej triaged this task as Medium priority.

Harej merged a task: T341643: http -> https.

Harej added a subscriber: Green_Cardamom.

Per my duplicate task.. it's might be too much for the bot to check every http request two times.. but if we know an entire domain has moved to https, then it should be possible to include an optional feature in the interface to tell the bot it should check a URL for https if it's getting a 404 on http. If it gets a 200 on the https, then change the source URL to https and don't add an archive. It could go further by checking existing citations with url-status=dead and converting to live, but this is probably beyond the bot's scope right now.