Page MenuHomePhabricator

Let MeetBot logs be indexed and archived
Open, MediumPublicFeature

Description

Currently all crawling is disabled; it's probably just some stupid default value, I can't imagine any reason why (it's all public logs, loading some static HTML can't kill a server).
Considering that labs services must not be relied on, at the very least you should whitelist the Wayback machine https://archive.org/about/exclude.php . I don't know if empty disallow or Allow: / is best.

User-agent: ia_archiver
Disallow:


Version: unspecified
Severity: enhancement
URL: http://integration-meetbot.instance-proxy.wmflabs.org/robots.txt

Details

Reference
bz56533

Related Objects

StatusSubtypeAssignedTask
Resolvedscfc
OpenFeatureNone
OpenFeatureNone

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:34 AM
bzimport set Reference to bz56533.
bzimport added a subscriber: Unknown Object (MLST).
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Aklapper changed the subtype of this task from "Task" to "Feature Request".Feb 4 2022, 12:23 PM
Aklapper removed a subscriber: wikibugs-l-list.