disallowing robots on talk pages and deletion and "meta" talk pages pages in de.wikipedia
Closed, ResolvedPublic


Author: arnomane

Please add the content of the following attached file for de.wikipedia robots.txt under "User-agent: *"
The disallow for talk pages was voted in a large vote (see
http://de.wikipedia.org/wiki/Wikipedia:Meinungsbilder/Unterschriftensammlung_für_Nichtindizierung_von_Diskussionsseiten_durch_Suchmaschinen )
and would help very much with ongoing highly problematic discussions about topics that are currently in
the media and in court. I don't know if the "talk"-equivalent is necessary. I added it as you can reach
inside every local wiki the namespaces via their english name and you can ignore it if it is not needed
in order to make the "noindex" perfect.

Version: unspecified
Severity: normal
Platform: Other

bzimport added a subscriber: Unknown Object (MLST).
bzimport set Reference to bz4937.
bzimport created this task.Via LegacyFeb 9 2006, 8:20 PM
bzimport added a comment.Via ConduitFeb 9 2006, 8:22 PM

arnomane wrote:

additional lines the de.wikipedia robots.txt

Attached: robots.txt

brion added a comment.Via ConduitFeb 9 2006, 8:34 PM

The format is wrong in the attachment, but that's a detail.

I'll set up the vfd bits in robots.txt, and see about the talk pages separately.

bzimport added a comment.Via ConduitFeb 9 2006, 11:05 PM

arnomane wrote:

I have read the robots.txt page on meta so I guess the * are not necessary, right? Concerning the talk pages there was at first another
idea (also documented at the web link above) with adding <meta name="robots" content="noindex,follow" /> in every weg page via a change in
the MediaWiki software as it is with the "nofollow" for weblinks.

But a solution with robots.txt would avoid that this page gets even loaded so it would reduce the requests by web spiders.

tstarling added a comment.Via ConduitJun 4 2006, 12:42 AM

Resolved using meta tags.

bzimport added a comment.Via ConduitJun 13 2007, 2:54 PM

wikipedia wrote:

Please add
"Disallow: /wiki/Wikipedia:Vandalismusmeldung/"
below the line
"Disallow: /wiki/Wikipedia:Vandalensperrung/"
in robots.txt

Please also add the line
"Disallow: /wiki/Wikipedia:Gesperrte_Lemmata/"
in the same paragraph.

bzimport added a comment.Via ConduitAug 25 2007, 10:45 AM

shagge wrote:

As Tims request was not yet fullfilled and we had another discussion about this topic on OTRS-de-l we would kindly like to ask you to please at least add

Disallow: /wiki/Wikipedia:Vandalismusmeldung/

Besides that the following paths should be added:

Disallow: /wiki/Wikipedia:Gesperrte_Lemmata/
Disallow: /wiki/Wikipedia:Löschprüfung/
Disallow: /wiki/Wikipedia:L%C3%B6schprüfung/
Disallow: /wiki/Wikipedia:Administratoren/Notizen/
Disallow: /wiki/Wikipedia:Schiedsgericht/Anfragen/

Raymond added a comment.Via ConduitAug 27 2007, 8:52 AM

(In reply to comment #6)

Disallow: /wiki/Wikipedia:Gesperrte_Lemmata/
Disallow: /wiki/Wikipedia:Löschprüfung/
Disallow: /wiki/Wikipedia:L%C3%B6schprüfung/
Disallow: /wiki/Wikipedia:Administratoren/Notizen/
Disallow: /wiki/Wikipedia:Schiedsgericht/Anfragen/

Correction of the the 3rd line (Disallow: /wiki/Wikipedia:L%C3%B6schprüfung/)

Disallow: /wiki/Wikipedia:L%C3%B6schpr%C3%BCfung

Platonides added a comment.Via ConduitAug 27 2007, 8:01 PM

/me points to bug 6746

bzimport added a comment.Via ConduitNov 4 2007, 11:23 AM

jeluf wrote:

Please don't reopen bugs to request new things. Those bugs get lost within all these DPL requests.


Add Comment