Page MenuHomePhabricator

entity/Q64 was indexed in Google, should it have been?
Open, MediumPublic

Description

While looking around on Twitter I saw people talking about indexing of Wikidata entities on Google searches.

When searching for Q64, part way down the results we see a /entity/ page rather than a /wiki/ page.

Screenshot_20190703-192138.png (287×760 px, 39 KB)

This should probably not happen?

Twitter thread was https://twitter.com/neumarcx/status/1134189938772185089?s=19

Event Timeline

From the quickest of looks (and totally unofficial w.r.t. my employer, of course): I don't see the string "entity" in https://www.wikidata.org/robots.txt so it may not be excluded there

Addshore triaged this task as Medium priority.Oct 30 2019, 1:53 PM
Addshore added a project: SRE.
Addshore moved this task from incoming to needs discussion or investigation on the Wikidata board.
Addshore renamed this task from Review robots.txt for Wikidata in light of entity/Q64 being indexed to entity/Q64 was indexed in Google, should it have been?.Jan 22 2021, 11:52 PM
Addshore moved this task from Inbox to Product Realm on the [DEPRECATED] wdwb-tech board.