Not sure if this is a bug or just a functionality that needs an update.

Current situation:

• When using Google search and entering "Clayarena Wikibase" the Google search gives a result that links to a CSV download
• We can not allow those links to appear in Google search

Desired situation:

• All links and pages/links that are generated by the metadata-wikibase need a 'no index' function to avoid unexpected exposure in search engines

Example:
https://www.google.com/url?sa=t&source=web&rct=j&opi=89978449&url=https://wikibase-metadata.wmcloud.org/csv/metrics%3Fauthorization%3D0c528a8e-026f-4fd2-ae8b-bd832083256e&ved=2ahUKEwjxx7uf642UAxXVRfEDHXe8C-cQFnoECBoQAQ&usg=AOvVaw1-Lf3_Co8ZvDrrOwxOznET

AC:

• update authorization guid; distribute to need-to-know parties" to the implementation
• update URL first
• add robot.txt file