Allow list admins to train spam filters
Open, MediumPublic
Actions

Assigned To

None

Authored By

	Aklapper
	Feb 4 2020, 2:55 PM

Description

As a list admin of Wikimedia mailing lists, I regularly have to decline spam. The only option offered on https://lists.wikimedia.org/mailman/admindb/foo is "Discard all messages marked Defer".
As a list admin of non-Wikimedia mailing lists, https://lists.another-domain.foo/mailman/admindb/foo also offers "Use messages marked as Discard and Accept to train the Bayesian classifier".

I am simply wondering the latter option is not available in Wikimedia's Mailman UI.

I am aware of https://wikitech.wikimedia.org/wiki/Mailman#Fighting_spam_in_mailman which does not mention Bayesian classifications.
Some random further info seems to be e.g. https://spamassassin.apache.org/full/3.0.x/dist/doc/sa-learn.html or https://gist.github.com/benwebber/5631609

Event Timeline

Aklapper created this task.Feb 4 2020, 2:55 PM

Restricted Application added a project: SRE. · View Herald TranscriptFeb 4 2020, 2:55 PM

@Aklapper we will have to dig into this a bit, thank you!

jijiki triaged this task as Medium priority.Feb 5 2020, 6:50 PM

jijiki added a project: serviceops.

https://blogs.gnome.org/ovitters/2008/06/07/using-moderated-messages-to-train-the-bayes-classifier/

I’ve added a patch to Mailman

Oh darrn! Thanks Reedy! I never realized that this is a custom patch in GNOME's Mailman instance, sorry!
Feel free to decline if this is too much maintenance costs.

• Quiddity subscribed.Feb 14 2020, 8:51 PM

• ema moved this task from Backlog to General on the Wikimedia-Mailing-lists board.Jun 24 2020, 1:52 PM

jijiki moved this task from Incoming 🐫 to cross-team active on the serviceops board.Aug 17 2020, 11:46 PM

At this time we have no intent on carrying local mailman patches that haven't been merged upstream.

I found https://gitlab.com/mailman/mailman/-/issues/88 which is along the same lines as this request. Feel free to re-open this if you'd like to track that upstream request here too but I don't see much value since it doesn't exist at all yet.

There's some new interest in this, see https://lists.wikimedia.org/hyperkitty/list/listadmins@lists.wikimedia.org/message/I4NRRS23N3KMR7XH4GWYTKF72FI3Q4RB/

Effeietsanders awarded a token.May 7 2021, 11:59 PM

Old mailman was able to forward spam to an email address (supposedly the admin), and I have been using it on my old lists to forward spam to my spam-learning email address. I do not see this in Postorius, but it would be a generic solution.

Even more generic solution would be to be able to move the spam into a maildir++ folder locally and then process these as the local ops would like, feeding back to sa-learn or rspamd. (I actually use this method, but mine is not a clean upstream-only solution.)

jijiki removed a project: serviceops.Oct 17 2022, 2:13 PM

jijiki added a subscriber: Ladsgroup.

	F31547504: Screenshot from 2020-02-04 15-40-30.png
	Feb 4 2020, 2:55 PM

Allow list admins to train spam filtersOpen, MediumPublicActions

Description

Event Timeline

Allow list admins to train spam filters
Open, MediumPublic
Actions