Page MenuHomePhabricator
Create Task
Maniphest T181542

Monitoring for top IPs and User-Agents hitting the ORES service
Closed, ResolvedPublic
Actions

Description

When we get unreasonable bursts of traffic, we should be able to email or firewall the culprits.

This isn't public data, however, so we might need to use something other than Grafana.

Related Objects

Event Timeline

awight created this task.Nov 28 2017, 6:21 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 28 2017, 6:21 PM
awight moved this task from Unsorted to Maintenance/cleanup on the Machine-Learning-Team board.Jun 21 2018, 11:38 AM
Ladsgroup triaged this task as Medium priority.Nov 27 2018, 1:14 AM
Ladsgroup merged a task: T182222: Create Grafana graph to show number of ORES API requests per user-agent.
Ladsgroup added subscribers: akosiaris, fgiunchedi, Ladsgroup.

Let's do it in logstash by sending the proper json from uwsgi to logstash. I can work on it in some time.

awight added a comment.Nov 27 2018, 1:22 AM

@Ladsgroup Do you have thoughts about the privacy issues? I don't think we release raw user-agent any more, although there's some historical precedent here. These days, we seem to summarize by family, but that wouldn't be very helpful for our purposes.

Ladsgroup added a comment.Nov 27 2018, 6:34 AM
In T181542#4776461, @awight wrote:

@Ladsgroup Do you have thoughts about the privacy issues? I don't think we release raw user-agent any more, although there's some historical precedent here. These days, we seem to summarize by family, but that wouldn't be very helpful for our purposes.

So the plan is to have the data in logstash which is already behind NDA.

awight added a comment.Nov 27 2018, 6:08 PM
In T181542#4776713, @Ladsgroup wrote:

So the plan is to have the data in logstash which is already behind NDA.

Thanks for pointing that out!

awight unsubscribed.Mar 21 2019, 4:01 PM
Ladsgroup unsubscribed.Apr 17 2019, 7:14 PM
fgiunchedi moved this task from Inbox to Radar on the observability board.Dec 9 2019, 12:12 PM
• ACraze moved this task from Maintenance/cleanup to Backlog/ORES on the Machine-Learning-Team board.Jan 19 2021, 10:20 PM
fgiunchedi removed a project: observability.Oct 22 2021, 12:25 PM

-observability for backlog cleanup

elukey closed this task as Resolved.May 29 2023, 9:23 AM
elukey claimed this task.
elukey subscribed.

There is a dashboard in logstash that the machine learning team created :)

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits