Page MenuHomePhabricator

Monitoring for top IPs and User-Agents hitting the ORES service
Open, MediumPublic

Description

When we get unreasonable bursts of traffic, we should be able to email or firewall the culprits.

This isn't public data, however, so we might need to use something other than Grafana.

Event Timeline

awight created this task.Nov 28 2017, 6:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 28 2017, 6:21 PM
Ladsgroup triaged this task as Medium priority.Nov 27 2018, 1:14 AM
Ladsgroup added subscribers: akosiaris, fgiunchedi, Ladsgroup.

Let's do it in logstash by sending the proper json from uwsgi to logstash. I can work on it in some time.

@Ladsgroup Do you have thoughts about the privacy issues? I don't think we release raw user-agent any more, although there's some historical precedent here. These days, we seem to summarize by family, but that wouldn't be very helpful for our purposes.

@Ladsgroup Do you have thoughts about the privacy issues? I don't think we release raw user-agent any more, although there's some historical precedent here. These days, we seem to summarize by family, but that wouldn't be very helpful for our purposes.

So the plan is to have the data in logstash which is already behind NDA.

So the plan is to have the data in logstash which is already behind NDA.

Thanks for pointing that out!

awight removed a subscriber: awight.Mar 21 2019, 4:01 PM
fgiunchedi moved this task from Inbox to Radar on the observability board.Dec 9 2019, 12:12 PM