it returns http 200 but it just says "The Grid ceased publication on July 3, 2014." for all pages. I wonder if some feature could be added to check if the size of the page is less than a certain amount, and if so, check to see if the archived page is significantly larger.
Description
Description
Related Objects
Related Objects
- Mentioned Here
- T193158: Detect unsuitable archive snapshots
Event Timeline
Comment Actions
I've blacklisted the domain, IABot should now consider it as dead no matter the HTTP response.
Automatically checking whether an archived page "makes sense" is quite difficult to get right, computationally expensive and currently out of scope of IABot. Similar ideas are tracked in T193158: Detect unsuitable archive snapshots.
I vaguely remember that there was a research project announced by the WMF (I believe related to this projekt) which was to look at ways to check whether a reference indeed contains the information in the sentence it applies to. I cannot find a link, but the task would be similar to what you propose.