Thank you! We'll reach out later (it's a bit busy over here right now, as you can imagine).

Thanks @jcrespo ! I didn't see your message until now and well, your warning was founded:
https://github.com/minio/minio/commit/27742d469462e1561c776f88ca7a1f26816d69e2 (minio in official maintenance mode now)

As @AStein-WMF 's manager, I approve.

Updates so far from Wenjun and Dami: https://office.wikimedia.org/w/index.php?title=Fundraising%2FEngineering%2FOn_call&diff=372087&oldid=352995

Moving to our current sprint (which will change in a couple hours from now) to keep track as we ensure there's no follow-up needed on our side.

For the record, the list of emails in my screenshot above have been marked as opt-out so no emails should go to them anymore.

(I'm deeming none of that as PII, even though I wouldn't normally paste the emails of any other contacts in Civi.)

Results of searching %@lists.wikimedia.org in Civi:

added that parent task (T87667) which has other Accessibility concerns (but is old, so might need re-review).

Moving back to Triage from Later.

Moving to done on chaos crew board, as the AWS outage is over (*knocks on wood*).

Changing from UBN! to High, since the acoustic-hosted links seem to be working again.

Noting that I'm prioritizing this investigation task due to the usage rate being very out of the ordinary and will required some significant budget re-arrangement to compensate. cc @AKanji-WMF @XenoRyet

Approved!

Thanks Peter and thanks for the config change. Do you want to manage the deploy of this through a backport window or have someone of fr-tech? https://wikitech.wikimedia.org/wiki/Backport_windows

done: https://donate.wikimedia.org/w/index.php?title=Template:2012FR/Form-countryspecific-control/US&action=history

Folks are reporting it works again, we'll uncomment that commented out line above ^.

Thread with Gravy & Trustly: https://wikimedia.slack.com/archives/C07JA677QDQ/p1759518709277799

https://donate.wikimedia.org/w/index.php?title=Template:2012FR/Form-countryspecific-control/US&diff=prev&oldid=41743

At 10:09am pacific from Gravy:

Hey @Cstone, our team has released a fix for this issue. We'll be monitoring closely at UTC midnight to ensure everything is working as expected.

T402062: Fundraising access request for Lars Sander-Green

Oops: T402061: Fundraising access request for Stacy Burnett

After more investigation the next steps are to turn it back on and see if the deadlocks reoccur.

Greg Grossmeier <greg@wikimedia.org> Mon, Aug 18, 2025 at 8:00 AM
To: Lisa Gruwell <lgruwell@wikimedia.org>
Cc: Jeff Green <jgreen@wikimedia.org>, Avishua Stein <astein@wikimedia.org>
Hello Lisa,

Greg Grossmeier <greg@wikimedia.org> Mon, Aug 18, 2025 at 8:00 AM
To: Lisa Gruwell <lgruwell@wikimedia.org>
Cc: Jeff Green <jgreen@wikimedia.org>, Avishua Stein <astein@wikimedia.org>
Hello Lisa,

We discussed this internally briefly and I agree that we should turn off the frdata update job until we can determine the root cause and mitigations.

(changing from UBN to High as this should be resolved, we just wait to actually close tasks until our sprint review)

Relevant slack thread with dlocal that @AnnWF re-poked to get info from them: https://wikimedia.slack.com/archives/C072S0VFH42/p1749739060959609

summary of discussion during fr-tech backlog triage call: We're pretty certain if the only thing changing in the cookie is setting the expiry date, CentralNotice should consume/use correctly.

Kindly asking for help diagnosing this Release-Engineering-Team.

Moving this out of unscheduled into Triage for us (FR Tech) to re-review/prioritize our side on it as it's a thing that needs cross-team (Traffic and FR-Tech) coordination.

Discussed in Office Hours with Rakhi, we can close and monitor with Gravy in our ongoing calls.

(Reprioritzing as high to match the joint gravy&wmf tracking sheet)

Heya @DerHexer, no real update on this as our last couple sprints worth of time (iow: most/all of July) we've been pretty short staffed (vacations, sabbaticals, and sicknesses combined) and this was unfortunately not prioritized during that time.

Just an update on timing: there is a campaign scheduled to go out tomorrow afternoon UTC that would use this payment method.

From Rakhi via a slack channel (not sure which one, I don't have access):

FYI: this maintenance week has moved from late Aug to late Sept due to the needs of the email team (discussed during the Tech/Online/Ops Leads call today).

Found the original access request (T292222: Fundraising access request for Janna Layton) and it looks like only superset access was given (eg: none of the external accounts).

It didn't happen yesterday even though we had the usual daily recurring go through.

Not sure what that middle plateau is about, but we're back down to a reasonable queue it seems.

Now it's just sitting at ~3k in the mailqueue for some reason:

Copying over @EMartin's comments from the dupe task: