Page MenuHomePhabricator

Bot unable to send messages to wikipedia-fr-wikimag
Closed, ResolvedPublic

Description

Hi,

I run a bot that automatically sends a newsletter to the mailing list wikipedia-fr-wikimag (https://lists.wikimedia.org/mailman/listinfo/wikipedia-fr-wikimag) by converting a wiki page. The publication was paused since 2019 but was restarted last week. However, when the bot tried to send the e-mail, nothing happened.

The list exists specifically for that reason and my bot is the only one to post there. The last time it works was in December 2019 (https://lists.wikimedia.org/pipermail/wikipedia-fr-wikimag/2019-December/000294.html).

On the bot side, there was no visible error when the message was sent. But it did not reach the mailing list. I am an admin of the list, and I didn't receive a message saying that the message was rejected or required approval, so I am unable to debug the issue. Do you know what could block the message?

Additional information:

  • Manually re-running the script to send the e-mail didn't help.
  • If I configure the bot to send an e-mail to me instead of the mailing list, it works, although my mail provider puts "[SPAM]" in the title. My first guess is that Wikimedia list server could filter it for the same reason. It would make sense: my bot runs on a VPS with an IP in the range 51.83.0.0/16, which is globally blocked on Wikipedia because it's full of compromised servers. Could it be the reason?
  • The script that sends the e-mail looks like this: https://fr.wikipedia.org/wiki/Utilisateur:Orlodrim/Wikimag (no change since the last successful message sent). Another hypothesis is that it's buggy somehow, so the messages may look more spammy than e-mails generated by a well-behaved clients. However, I don't know how I could check.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Marostegui added subscribers: herron, Marostegui.

@herron could you take a look at this?

Marostegui triaged this task as Medium priority.Oct 19 2020, 6:18 AM

@Orlodrim If you know how to check your mail headers, If you look at the one that is sent to you instead of the mailing list that adds [SPAM], Can you have a look to see X-Spam-Score header is added? Anything with a score of 6+ gets automatically discarded.

When I send an e-mail to myself without going through the mailing list server, it get the following spam tags:

X-Ovh-Tracer-Id: 8141945179226048193
X-Ovh-Remote: 213.186.33.59 (b9.ovh.net)
X-VR-SPAMSTATE: SPAM
X-VR-SPAMSCORE: 500
X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedujedrjedugdefhecutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfqggfjpdevjffgvefmvefgnecuuegrihhlohhuthemucehtddtnecuogfhohhrsghiugguvghnjfgurhculdehtddtmdenucfjughrpegtggfufffhvfesrgdttdertddtjeenucfhrhhomhepohhrlhhoughrihhmsghothesfihsthgrthdrfhhrnecuggftrfgrthhtvghrnhepveduleelffeitdetkeevgefhffeivdfgteekueeutdelteejudfhgfeghfdvudejnecuffhomhgrihhnpeifihhkihhpvgguihgrrdhorhhgpdhsihgvtghlvgguihhgihhtrghlrdhfrhdpfhhrrghntggvshhoihhrrdhfrhdphihouhhtuhgsvgdrtghomhdpfihikhhimhgvughirgdrohhrghdplhgvtghouhhrrhhivghrrdgvshdpmhhsnhdrtghomhdplhgvtghouhhrrhhivghruggvrhhushhsihgvrdgtohhmnecukfhppedtrddtrddtrddtpdehuddrkeefrdegtddrvdeknecuhfhorhgsihguuggvnhfjughrpegtggfufffhvfesrgdttdertddtjeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhhouggvpehsmhhtphdphhgvlhhopehinheivddrmhgrihhlrdhovhhhrdhnvghtpdhinhgvtheptddrtddrtddrtddpmhgrihhlfhhrohhmpehorhhlohgurhhimhgsohhtseifshhtrghtrdhfrhdprhgtphhtthhopehorhhlohgurhhimhesfihsthgrthdrfhhr
X-Ovh-Spam-Status: SPAM
X-Ovh-Spam-Reason: vr: SPAM; dkim: disabled; spf: disabled
X-Ovh-Message-Type: SPAM
X-Spam-Tag: YES

Of course, in that case, it doesn't go through Wikimedia servers at any point, so I'm not sure the spam detection system is the same, but it clearly gets a high score. I copied the full e-mail with all headers here: https://wstat.fr/divers/full-email.txt

I tried to send the issue of the week in plain text format, and it worked. This confirms that the e-mail is filtered due to its content (at least partially).
Is there a way to add a rule to the spam filters to allow my bot to send e-mail to that list?

Also, the plain text message already reaches a X-Spam-Score of 3.1 mostly because of the following detection:
3.0 WIKI_IMG URI: Image from wikipedia
Maybe this could be disabled for Wikimedia mailing lists?

HTML messages are still consistently blocked.
Is there at least a way to get the log of the spam filter?
I went through past messages and tried to fix another detection that already existed at the time message were still accepted (TO_NO_BRKTS_HTML_IMG), it didn't help. Without having access to additional information, it's hard for me to fix the issue.

Orlodrim claimed this task.

The last 6 emails passed the spam filter, so I'm closing this bug. It might have been solved by the recent update of mailman.