IABot incorrectly marks social media dead links as live
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	archivelover
	Nov 3 2021, 1:14 AM

Description

I realized, while on my youtube archive edit run, that IABot does not recognize dead youtube links. It incorrectly marks all youtube pages as "live", even if the video is gone. See https://en.wikipedia.org/w/index.php?title=User:Rlink2/sandbox&action=history - i think the first link (https://www.youtube.com/watch?v=Rtm909-d8uo) is dead, but it is marked as live instead.

In the meanwhile, I'm manually marking dead youtube videos as dead and replacing them with a Wayback reference.

Edit: applies to other social media sites, see comment below

Event Timeline

archivelover created this task.Nov 3 2021, 1:14 AM

Harej moved this task from Inbox to Backlog: URLs on the InternetArchiveBot board.Nov 3 2021, 1:18 AM

BrownHairedGirl subscribed.Dec 15 2021, 12:59 AM

Mathglot subscribed.Dec 21 2021, 10:00 PM

IABot is also not handling Instagram links properly, see https://en.wikipedia.org/w/index.php?diff=prev&oldid=1061595799. While it does add a working Wayback reference, that link is currently dead (even if you get past loginwall) but it is marked as live.

And the same applies for Twitter, since they return a 200 response code even for dead tweets.

The instagram domain was improperly marked as "permalive" and this has been fixed. The listed YouTube URL returns a 200 status code for dead videos, which to the bot means the link is alive.

Restricted Application added a project: User-Harej. · View Herald TranscriptMay 2 2022, 7:06 PM

IABot incorrectly marks social media dead links as liveClosed, ResolvedPublicActions

Description

Event Timeline

IABot incorrectly marks social media dead links as live
Closed, ResolvedPublic
Actions