Page MenuHomePhabricator

Write a script to parse StopForumSpam logs and make some stats
Closed, DeclinedPublic

Description

With no logstash (T233134), we're limited to logfiles on disk... So could be worth writing some scripts to do a bit of analysis and statistics from the beta StopForumSpam log files.

Sample raw log entry:

2021-01-01 01:01:01 [aaaabbbbCCCCddddEEEEffff] deployment-mediawiki-01 enwiki 1.36.0-alpha StopForumSpam INFO: 111.222.333.444 tripped SFS deny list doing createaccount by using 111.222.333.444 on "Special:CreateAccount".
{"action":"createaccount","clientip":"111.222.333.444","reportonly":true,"title":"Special:CreateAccount","user":"111.222.333.444"}

Relevant logging code here, here and here.

Event Timeline

Reedy renamed this task from Write a script to parse stopforumspam logs and make some stats to Write a script to parse StopForumSpam logs and make some stats.Jan 29 2021, 2:37 AM

Given T304111#7814870 and T304519, I feel like we could possibly decline this now? Unless we want to do fancier stats than what logstash allows.

I think we can. We can probably replace this request with one to make some sort of logstash dashboard for SFS hits (if you haven't created one already).

sbassett moved this task from Backlog to Done on the MediaWiki-extensions-StopForumSpam board.

I think we can. We can probably replace this request with one to make some sort of logstash dashboard for SFS hits (if you haven't created one already).

I haven't, other than perusing channel:StopForumSpam. I feel like that gives us enough raw stats for now, re: number of blocks, number of exemptions. If we need details beyond that, then we could create a dashboard or write some custom export.