Surface slow filters and total condition count directly on Special:AbuseFilter
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	• TBolliger
	Sep 27 2017, 5:59 PM

Description

Once the tickets listed below are complete (or rejected) we should decide how to indicate slow filters and the total condition count directly on Special:AbuseFilter. We'll want to talk with edit filter managers before we make any decisions.

The Current ideas

Update the count at the top of Sp:AbuseFilter to include an average count of how many conditions were used over the past N hours.
Add the per-filter profiling back (which is viewable on the individual filter pages) and add data from Logstash if the filter takes over 800MS
TBD: Indicate the filters that take over 800MS directly on the main Sp:AbuseFilter page

Blocking tickets

Related Objects
Search...

Status	Assigned	Task
Open	None	T209023 Major overhaul for AbuseFilter
Open	None	T193064 Create a dedicated page for stats
Open	None	T191428 Enhance filter profiling
Open	None	T179604 Move AbuseFilter slow filters data from Logstash to per-filter profiling
Declined	None	T176895 Surface slow filters and total condition count directly on Special:AbuseFilter

Event Timeline

• TBolliger created this task.Sep 27 2017, 5:59 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 27 2017, 5:59 PM

@MusikAnimal @dmaza — When T174205: Log cases where abusefilter filters take over a certain amount of time to run is complete, what would be a helpful way to surface this information to Edit filter managers? A separate tool? Email notifications? Something on Special:AbuseFilter?

In T176895#3662524, @TBolliger wrote:

When T174205: Log cases where abusefilter filters take over a certain amount of time to run is complete, what would be a helpful way to surface this information to Edit filter managers? A separate tool? Email notifications? Something on Special:AbuseFilter?

Having this information anywhere is a huge step forward, but I think putting it in Special:AbuseFilter would be best. Maybe Special:AbuseFilter/SlowFilters (probably can come up with a better name)? There it'd have a table of the slow filters with the average run time and condition count (assuming you're keeping track of that). You could also highlight the expensive ones at Special:AbuseFilter in yellow or something. My thoughts are that if it's on a separate page or tool, it might go unnoticed, when ideally we'd want them to be abundantly aware there is something wrong with a particular filter. The folks at https://en.wikipedia.org/wiki/Wikipedia:Edit_filter_noticeboard might have some good ideas too.

Let's get the monitoring in place for the filters first, then show it to the folks on the Edit filter noticeboard. I agree that out of sight = out of mind. Maybe even a new column on Special:AbuseFilter?

• TBolliger moved this task from Snackbox to Analytics on the Anti-Harassment board.Oct 11 2017, 5:57 PM

BethNaught subscribed.Oct 27 2017, 5:45 PM

• TBolliger added a comment.Nov 2 2017, 11:07 PM

This comment was removed by • TBolliger.

• TBolliger renamed this task from Surface slow AbuseFilter filters to Edit filter managers to Surface slow filters and total condition count directly on Special:AbuseFilter.Nov 2 2017, 11:11 PM

• TBolliger updated the task description. (Show Details)

• TBolliger mentioned this in T179323: Enable AbuseFilter per-filter profiling on English Wikipedia & monitor if there is a performance impact.Nov 21 2017, 12:40 AM

He7d3r subscribed.Nov 22 2017, 1:28 AM

• TBolliger removed a project: Anti-Harassment.Jan 17 2018, 12:29 AM

MusikAnimal mentioned this in T185154: AbuseFilter (and dependencies): code stewardship review.Jan 29 2018, 6:02 PM

Daimona added a parent task: T191428: Enhance filter profiling.Apr 6 2018, 5:27 PM

Daimona added a subtask: T179604: Move AbuseFilter slow filters data from Logstash to per-filter profiling.

Daimona removed a subtask: T179604: Move AbuseFilter slow filters data from Logstash to per-filter profiling.Apr 6 2018, 5:32 PM

Daimona edited parent tasks, added: T179604: Move AbuseFilter slow filters data from Logstash to per-filter profiling; removed: T191428: Enhance filter profiling.