Mentioned in SAL (#wikimedia-operations) [2026-04-08T21:00:04Z] <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1269050|Use envoy for swift inside mediawiki (T328872)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
- Feed Queries
- All Stories
- Search
- Feed Search
- Transactions
- Transaction Logs
Feed All Stories
All Stories
All Stories
Wed, Apr 8
Wed, Apr 8
Redmin updated the task description for T422742: Hitting a rate limit trying to execute function relying on Wikidata statements.
Redmin updated the task description for T422742: Hitting a rate limit trying to execute function relying on Wikidata statements.
Stashbot added a comment to T328872: Commons: UploadChunkFileException: Error storing file: backend-fail-internal; local-swift-codfw.
Wed, Apr 8, 9:00 PM · Patch-For-Review, MW-1.46-notes (1.46.0-wmf.14; 2026-02-03), MW-1.45-notes (1.45.0-wmf.22; 2025-10-07), API Platform, MediaWiki-File-management, MW-1.41-notes (1.41.0-wmf.25; 2023-09-05), Unstewarded-production-error, MediaWiki-Uploading, Wikimedia-production-error, SRE-swift-storage, Commons
Jdlrobson-WMF moved T417513: Switch to CSS/JS solution for thumbnail size in legacy parser from For triage to Tracking on the Readers Essential Work board.
taavi added a comment to T422509: Cloud init and unattended upgrades while bootstrapping Trixie VMs.
This is not an unattended-upgrades problem. It instead seems to be a problem with how the Puppet agent packages are installed - Trixie by default includes Puppet 8, but our codebase is not yet fully compatible with Puppet 8 (and particularly its removal of deprecated facts), so we need to pull in the Puppet 7 agent packages from a component on apt.wm.o.
Stashbot added a comment to T328872: Commons: UploadChunkFileException: Error storing file: backend-fail-internal; local-swift-codfw.
Mentioned in SAL (#wikimedia-operations) [2026-04-08T20:58:12Z] <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1269050|Use envoy for swift inside mediawiki (T328872)]]
Wed, Apr 8, 8:58 PM · Patch-For-Review, MW-1.46-notes (1.46.0-wmf.14; 2026-02-03), MW-1.45-notes (1.45.0-wmf.22; 2025-10-07), API Platform, MediaWiki-File-management, MW-1.41-notes (1.41.0-wmf.25; 2023-09-05), Unstewarded-production-error, MediaWiki-Uploading, Wikimedia-production-error, SRE-swift-storage, Commons
Jdlrobson-WMF edited projects for T318991: Review frontend for pages with large amounts of images and headings, added: Readers Essential Work; removed Readers Essential Work (WE6.3.4 Fix bugs within the reading experience across platforms for Parsoid Read Views).
When Parsoid is default this limitation can likely be removed completely.
gerritbot added a comment to T328872: Commons: UploadChunkFileException: Error storing file: backend-fail-internal; local-swift-codfw.
Change #1269050 merged by jenkins-bot:
[operations/mediawiki-config@master] Use envoy for swift inside mediawiki
Wed, Apr 8, 8:58 PM · Patch-For-Review, MW-1.46-notes (1.46.0-wmf.14; 2026-02-03), MW-1.45-notes (1.45.0-wmf.22; 2025-10-07), API Platform, MediaWiki-File-management, MW-1.41-notes (1.41.0-wmf.25; 2023-09-05), Unstewarded-production-error, MediaWiki-Uploading, Wikimedia-production-error, SRE-swift-storage, Commons
ppelberg triaged T422740: Implement Suggestion Mode instrumentation spec in Test Kitchen as High priority.
Mooeypoo renamed T422739: OpenAPI linting: Add missing OpenAPI spec elements to Response Components from OpenAPI linting: Add "examples" to generated schema to OpenAPI linting: Add missing OpenAPI spec elements to Response Components.
Jdlrobson-WMF edited projects for T358273: Remove Vector's unused broken configuration flags for user skin preference, added: Readers Essential Work (Sunsetting); removed Readers Essential Work.
It would be quite useful to be able to execute these images via components and not have to execute them on NFS workers (which appear to have the worst availability).
Andrew renamed T422515: wmcs cookbook "--project" arg is ambiguous, could mean project id or project name from Handle project IDs with dash in cloud cookbooks / openstack API to wmcs cookbook "--project" arg is ambiguous, could mean project id or project name.
@ABorbaWMF
Are we able to do a full smoketest on Browserstack for iOS 18?
ppelberg updated the task description for T422736: Define and implement any missing metrics needed for Suggestion Mode controlled experiment.
Andrew triaged T422515: wmcs cookbook "--project" arg is ambiguous, could mean project id or project name as Medium priority.
For starters we should probably look for places that take a --project arg and convert them to either --project-id or --project-name depending on what the code does.
Andrew triaged T422538: Connection with `k8s.tools.eqiad1.wikimedia.cloud` hits SSL error as Medium priority.
Andrew added a comment to T422538: Connection with `k8s.tools.eqiad1.wikimedia.cloud` hits SSL error.
@Nokib_Sarkar have you seen this happen on multiple occasions, or just several times on the 7th specifically? (I want to make sure it's not a side-effect of maintenance activity.)
Stashbot added a comment to T128546: [Recurring Task] Update Wikipedia and sister projects portals statistics.
Mentioned in SAL (#wikimedia-operations) [2026-04-08T20:40:14Z] <jdrewniak@deploy1003> Finished scap sync-world: Backport for [[gerrit:1269046|Bumping portals to master (T128546)]] (duration: 06m 14s)
Andrew triaged T422509: Cloud init and unattended upgrades while bootstrapping Trixie VMs as Medium priority.
Do you have any theory (you being @elukey and @fgiunchedi) about why that happened on this exact instance? I just checked and we have around 100 running Trixie VMs so presumably cloud-init works properly most of the time.
DMartin-WMF updated the task description for T419368: Evaluator-Orchestrator callbacks: Ensure one-at-a-time use of callbacks.
gerritbot added a comment to T422509: Cloud init and unattended upgrades while bootstrapping Trixie VMs.
Change #1269056 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] nova vendordata: disable unattended upgrades in base image
gerritbot added a comment to T422738: Centralize API error handling for bad authorization tokens between OAuth and CentralAuth.
Change #1264746 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):
[mediawiki/extensions/CentralAuth@master] CentralAuthTokenSessionProvider: Use core code for exception-throwing sessions
gerritbot added a comment to T422738: Centralize API error handling for bad authorization tokens between OAuth and CentralAuth.
Change #1269051 had a related patch set uploaded (by Bartosz Dziewoński; author: Bartosz Dziewoński):
[mediawiki/core@master] SessionProvider: Improve makeException()
HNordeenWMF updated the task description for T416648: [Epic] 25th Birthday Reading Challenge Module & Widget on Apps.
AndrewTavis_WMDE updated the task description for T420757: [Analytics] [Request] Investigate clustering of Wikidata survey responses.
In T422097#11797498, @AWesterinen-WMF wrote:A slightly different take on this is whether the answers that are being diff'ed are correct/definitive.
Stashbot added a comment to T128546: [Recurring Task] Update Wikipedia and sister projects portals statistics.
Mentioned in SAL (#wikimedia-operations) [2026-04-08T20:35:49Z] <jdrewniak@deploy1003> jdrewniak: Backport for [[gerrit:1269046|Bumping portals to master (T128546)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
How about:
matmarex added a comment to T421778: Action API requests with centralauthtoken=… should produce CORS headers if the token is invalid.
I'll move the bigger refactoring patch to T422738, so that we can put it off for later.
Stashbot added a comment to T128546: [Recurring Task] Update Wikipedia and sister projects portals statistics.
Mentioned in SAL (#wikimedia-operations) [2026-04-08T20:34:00Z] <jdrewniak@deploy1003> Started scap sync-world: Backport for [[gerrit:1269046|Bumping portals to master (T128546)]]
matmarex added subtasks for T422738: Centralize API error handling for bad authorization tokens between OAuth and CentralAuth: T421777: Passing an invalid token via "Authorization: CentralAuthToken …" header should result in an error, not an anonymous session, T421778: Action API requests with centralauthtoken=… should produce CORS headers if the token is invalid.
srishakatux updated https://gitlab.wikimedia.org/repos/lpl/starterkit-v1/-/merge_requests/10
Ejegg added a comment to T421960: Donor Portal - investigation required: recurring upgrade email activity tracking parameter issue.
@CHudson-WMF I set all the ones with tracking medium = email to 'no'. Do the numbers look good now?
Seems like a reasonable column/subproject of Technical-Debt .
srishakatux closed https://gitlab.wikimedia.org/repos/lpl/starterkit-v1/-/merge_requests/8
Maintenance_bot removed a project from T422180: Replace use of fetch() in WikiLambda code with proper mw.api calls: Patch-For-Review.
Maintenance_bot removed a project from T422548: Deployment: Disable the config flag for extension:WP25EasterEggs: Patch-For-Review.
Maintenance_bot removed a project from T422185: Undeploy StopForumSpam extension from Wikimedia production: Patch-For-Review.
Umherirrender removed a project from T302667: Document any scalar types for RdfWriter::value: Patch-For-Review.
Ladsgroup added a comment to T157614: Investigate if it is legally okay to have h264 decoder run on production and/or labs, or provide the decoder in JS for a browser to run.
Cross-referencing with T358266#11801688 Legal department has officially signed off on allowing to upload/store/convert of MPEG 4 Part II after July 19th, 2026. Do you think it's enough for you or do you want to still look into MPEG-4 Part 10? (They have patents pending up to 2030 so we need to look into the royalties discussion and whether we should pay or not)
Change #1267935 merged by jenkins-bot:
[purtle@master] Explicit cast all values in RdfWriterBase::value()
As a member of the netbox-readonly-access, I can still not log in to NetBox. Looks like I am experiencing the same redirect loop described in T373702#10449880:
https://idp.wikimedia.org/oidc/oidcAuthorize?client_id=netbox_oidc&redirect_uri=https://netbox.wikimedia.org/oauth/complete/oidc/&state=[state]&response_type=code&nonce=[nonce]&scope=openid profile email groups openid profile email (why have the latter three values been duplicated?)
https://netbox.wikimedia.org/oauth/complete/oidc/?code=[code]&state=[state]&nonce=[nonce]
https://netbox.wikimedia.org/login/?next=/
https://netbox.wikimedia.org/oauth/login/oidc/?next=/
https://idp.wikimedia.org/oidc/oidcAuthorize?client_id=netbox_oidc&redirect_uri=https://netbox.wikimedia.org/oauth/complete/oidc/&state=[state]&response_type=code&nonce=[code]&scope=openid profile email groups openid profile email
https://netbox.wikimedia.org/oauth/complete/oidc/?code=[code]&nonce=[nonce] (I'm not sure where &state= has gone)
(and so forth)
mpopov updated the task description for T421740: Switch experiment_assignment_v1 to use experiment_exposure events.
CodeReviewBot added a comment to T421740: Switch experiment_assignment_v1 to use experiment_exposure events.
Ladsgroup added a comment to T358266: TimedMediaHandler: Improve video quality on older iPhones (MPEG-4 Visual).
Legal has got back to me and said this:
the last patent for MPEG-4 Part 2 expires July 19th, 2026.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits