[{reqId}] {exception_url} PHP Warning: Undefined array key "x4"In the last hour, 5k error logs and 44 million warnings: https://logstash.wikimedia.org/goto/29e274633ee83f5d9311e30f990af8a5
It's probably related to creating the x4 section
| Subject | Author | Repo | Branch | Lines +/- | |
|---|---|---|---|---|---|
| etcd: Add support for x4 | Zabe | operations/mediawiki-config | master | +1 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T196020 Consider adding ContentTranslation (CX) tables to wiki replicas | |||
| Open | Feature | None | T395072 Add "wikishared" database to wiki replicas | ||
| Open | None | T428047 Upgrade clouddb* hosts to Debian Trixie | |||
| Unknown Object (Task) | |||||
| Resolved | Jclark-ctr | T409162 Q2:rack/setup/install clouddb1026-1033 | |||
| Stalled | None | T387419 Create wiki replicas views for globaljsonlinks tables | |||
| Stalled | None | T395881 Set up x1 replication to Wiki Replicas | |||
| Duplicate | Marostegui | T408692 Set up replication on new hosts clouddb102[2-5] | |||
| Open | None | T343131 Commons database is growing way too fast | |||
| Open | Ladsgroup | T398709 FY2025-26 WE 6.4.1: Move links tables of commons to a dedicated cluster | |||
| Resolved | None | T437111 Split production writes for commons link tables | |||
| Open | Marostegui | T434048 Decommission clouddb1013-clouddb1020 | |||
| Resolved | Marostegui | T409557 Productionize new clouddb* hosts (clouddb1022-1033) | |||
| Resolved | Marostegui | T404715 Setup x4 section | |||
| Resolved | PRODUCTION ERROR | Zabe | T431989 PHP Warning: Undefined array key "x4" |
Change #1310061 had a related patch set uploaded (by Zabe; author: Zabe):
[operations/mediawiki-config@master] etcd: Add support for x4
Change #1310061 merged by jenkins-bot:
[operations/mediawiki-config@master] etcd: Add support for x4
Mentioned in SAL (#wikimedia-operations) [2026-07-13T11:52:40Z] <zabe@deploy2003> Started scap sync-world: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]]
Mentioned in SAL (#wikimedia-operations) [2026-07-13T11:54:23Z] <zabe@deploy2003> zabe: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:00:18Z] <zabe@deploy2003> Finished scap sync-world: Backport for [[gerrit:1310064|Do not apply elwiki abusefilter settings to dewiki (T431934)]], [[gerrit:1310061|etcd: Add support for x4 (T431989)]] (duration: 07m 37s)
These are from maint scripts that are long running. once they finish, the new ones will be fixed. We can kill all of these pods but rather not
Adding an associated error for searchability:
[{reqId}] {exception_url} PHP Warning: foreach() argument must be of type array|object, null given