Our logfile analysis shows an uptick in failed GET requests to routes that only accept HTTP POST (adding donations, validating data). The failed attempts look like they came from crawlers. To signal to (well-behaved) crawlers to leave those URLs alone, we should update our robots.txt file
Description
Description
Event Timeline
Restricted Application added a project: WMDE-FUN-Team. · View Herald TranscriptDec 20 2018, 2:19 PM2018-12-20 14:19:46 (UTC+0)
gabriel-wmde moved this task from Todo to Review on the WMDE-Fundraising-Funban-2018 board.Dec 20 2018, 2:21 PM2018-12-20 14:21:09 (UTC+0)
Comment Actionsgabriel-wmde moved this task from Review to Deploy on the WMDE-Fundraising-Funban-2018 board.Dec 20 2018, 2:23 PM2018-12-20 14:23:00 (UTC+0)
Liuxinyu970226 added a parent task: T16720: robots.txt (tracking).Dec 23 2018, 11:16 AM2018-12-23 11:16:07 (UTC+0)
kai.nissen removed gabriel-wmde as the assignee of this task.Jan 3 2019, 2:48 PM2019-01-03 14:48:09 (UTC+0)