Looks to be working now, thanks for the very quick fix @Marostegui

In T311148#8020196, @Aklapper wrote:

I am running an SQL query involving the page table on all WMF wikis.

Where exactly and how? Is this PAWS or Quarry related, maybe?

Compare

CREATE ALGORITHM=UNDEFINED DEFINER=viewmaster@% SQL SECURITY DEFINER VIEW page AS select altwiki.page.page_id AS page_id,altwiki.page.page_namespace AS page_namespace,altwiki.page.page_title AS page_title,altwiki.page.page_restrictions AS page_restrictions,altwiki.page.page_is_redirect AS page_is_redirect,altwiki.page.page_is_new AS page_is_new,altwiki.page.page_random AS page_random,altwiki.page.page_touched AS page_touched,altwiki.page.page_links_updated AS page_links_updated,altwiki.page.page_latest AS page_latest,altwiki.page.page_len AS page_len,altwiki.page.page_content_model AS page_content_model,altwiki.page.page_lang AS page_lang from altwiki.page

and

CREATE ALGORITHM=UNDEFINED DEFINER=viewmaster@% SQL SECURITY DEFINER VIEW page AS select enwiki.page.page_id AS page_id,enwiki.page.page_namespace AS page_namespace,enwiki.page.page_title AS page_title,enwiki.page.page_is_redirect AS page_is_redirect,enwiki.page.page_is_new AS page_is_new,enwiki.page.page_random AS page_random,enwiki.page.page_touched AS page_touched,enwiki.page.page_links_updated AS page_links_updated,enwiki.page.page_latest AS page_latest,enwiki.page.page_len AS page_len,enwiki.page.page_content_model AS page_content_model,enwiki.page.page_lang AS page_lang from enwiki.page

per IRC

@tstarling: would a patch to allow disable with config be acceptable & suitable for backport?

In T310946#8013223, @RhinosF1 wrote:

In T310946#8013221, @MF-Warburg wrote:

Nonsense, please block the user.

Conversation ongoing in private re. Will be handled soon.

Done after talking to @Urbanecm in mixed Sysadmin & steward hat

In T310946#8013221, @MF-Warburg wrote:

Nonsense, please block the user.

Conversation ongoing in private re. Will be handled soon.

Please use a free wiki host as you've been told before.

@ChioGaming2007: Please let our SRE team handle things. We have already spoken to Tim so we can fix this. We will communicate with you if action is needed and have access to much more than you do on the technical side. Your article is not damaged, it just won't render.

@tstarling: that was the only log entry matching the request ID

We've also had issues at Miraheze now ETP is rolled out. I opened https://bugzilla.mozilla.org/show_bug.cgi?id=1774861 last night for Miraheze.

@BCornwall: See T306101: Cloud VPS "traffic" project Stretch deprecation which already exists and has some comments on regarding diff scan which has already been shut down via T306245: Upgrade diffscan to Bullseye and can likely just be deleted @ayounsi confirms working there.

This just alerted again:

14:09:04 <+icinga-wm> PROBLEM - mailman list info ssl expiry on lists1001 is CRITICAL: CRITICAL - Certificate lists.wikimedia.org expires in 7 day(s) (Sat 25 Jun 2022 07:55:09 AM GMT +0000). https://wikitech.wikimedia.org/wiki/Mailman/Monitoring

Hi, The warning added with this task is blocking some page views at Miraheze. Can we get guidance on how to fix.

This is likely the deploy by @tstarling - issue was already mentioned on IRC & https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/799433/

Nope :(

I think I mentioned this upstream before somewhere. Is the old forum still up?

As Amir said, this is expected downtime.

Thank you for updating the task.

In T310325#7995662, @Liz wrote:

And now there is a 34 hour lag! How can a system catch up with a lag longer than a day?

Don't worry about catching up, the systems are not normally lagged so it will recover when replication is back working. The DBAs & Service owners could also choose to reclone from another databases.

errorpages is not a MediaWiki extension. It doesn't have any way to parse wikitext.

We're a seperate farm so you can't use your wikimedia login. There is no maintenance tonight or ongoing outage.

Links will likely be @Ladsgroup I think although T299951: Normalize categorylinks table doesn't show any changes.

This is the same index as T309648: Restore lost index in cloudelastic

codesearch8 went down. I don't see anything logged.

Removing DBA as this doesn't affect Wikimedia Production (I assume or it would have long been seen) and I don't see a request for their assistance.

Hi translatewiki folks, we're currently running a fundraiser so we'd appreciate if any issues could be resolved quickly. @Verdy_p: thanks for making us aware.

I've added you, please shout if you have any questions!

Should this be closed then?

Looks like T308443 might be related

Possibly causing T309491: mwext-php72-phan-docker fails for Wikimedia Messages

Deployed build error

Hey, analytics1068 has been alerting about mega raid. I'm guessing that's expected.

Assuming this is aimed at the Android team so tagging as such.

T281593: Rename mainline Git branch from "master" to "main" on all WMF-hosted repositories during GitLab migration is the big tracking task

Wasn't the recommendation to do this when moving to gitlab.

This should be resolved now

T293826: flapping icinga Letsencrypt TLS cert alerts around renewal time maybe?

Dupe of mentioned task

Please can this be backported

@Dmantena: Can you file a new task using https://phabricator.wikimedia.org/maniphest/task/edit/form/8/ or copy the information from that form into this task?

I've left a message with Analytics to check but based on https://wikitech.wikimedia.org/wiki/Analytics/Data_access#What_access_should_I_request?, I think this may need shell access / a posix user too.

@Aklapper: @rook confirmed they could reproduce via email too.

In T305998#7924382, @Aklapper wrote:

not sure if requesting deployment training makes sense if you're not trusted but maybe I'm nitpicking here...

In T305998#7924227, @Aklapper wrote:

Edit Policy of Form 96 is set to author, admins, subscribers, and members of { Trusted-Contributors | WMF-NDA }. That makes sense to me.

Which is exactly the same as in this task which seems to be hinting it should be made All users

In T305998#7854480, @Aklapper wrote:

Hmm, the setting that Majavah found has not been changed since 2019 (which makes me assume that nearly all Forms have a non-default setting) and its current setting probably had to do with vandalism.

Form 96 is definitely affected

I hereby license all my current and future contributions to the operations/puppet under the Apache 2.0 license.

In T305216#7902012, @AlexisJazz wrote:

In T305216#7899173, @hashar wrote:

I have looked at the new errors in the log and it is quiet. There are a very few showing up which are already tracked and with a low frequency, thus it looks good. There are three blocker tasks still.

What about T306758 and T307173?

Both of them are JobQueue issues so I'd be more inclined to wonder if beta isn't processing jobs properly.

Note: On-Wiki rename disputed at https://meta.wikimedia.org/wiki/Stewards%27_noticeboard#Please_remove_User%3AMetaverse_from_Global_renamer_group_and_revert_%2391629_rename

No problem. I strongly recommend replacing DSA keys where you use them.

In T307270#7893169, @Xqt wrote:

In T307270#7893168, @RhinosF1 wrote:

Can you try a more modern key?

Which one would be suitable? PuttyGen accepts RSA, DSA, ECDSA, EdDSA and SSH-1 (RSA).

RSA or ECDSA I believe

Can you try a more modern key?