Currently robots represent an important part of Quarry traffic. We should define what they should index then fill robots.txt and meta ref links values in consequence.
Description
Description
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Open | None | T224338 Define a robot policy for Quarry then create robots.txt file | |||
Open | None | T197488 Add nofollow attribute in some links to prevent bots from following unnecessary ones |