Page MenuHomePhabricator

⬆️ Investigate SQLBagOStuff Duplicate get error
Open, Needs TriagePublic

Description

Investigate

[SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times

from https://console.cloud.google.com/errors/detail/CLLJm-eviqOjaw;time=P7D;locations=global?project=wikibase-cloud

Extracted from T408101: ⬆️ Investigate Expectation (masterConns <= 0) errors

I think I dug up this ticket T237143 as relevant to

[SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times

Seems like the solution temporarily is to silence it; or to wait until 1.44+ where there is a fix. An example of how to silence (but for a different cache type) can be seen at https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/552257/3/wmf-config/CommonSettings.php

Event Timeline

Tarrow renamed this task from Investigate SQLBagOStuff Duplicate get error to ⬆️ Investigate SQLBagOStuff Duplicate get error.
Tarrow moved this task from To do to Doing on the Wikibase Cloud (Kanban Board) board.
Tarrow updated the task description. (Show Details)

dati18 opened https://github.com/wbstack/mediawiki/pull/500

Add patchUrl to Echo extension to fix SQLBagOStuff duplicate warnings

@Ollie.Shotton_WMDE and I decided to backport the Echo patch to fix the SQLBagOStuff duplicate warnings

dang removed dang as the assignee of this task.Dec 9 2025, 11:34 AM
dang moved this task from Doing to Ready for Peer Review on the Wikibase Cloud (Kanban Board) board.
dang subscribed.

dati18 closed https://github.com/wbstack/mediawiki/pull/500

Add patchUrl to Echo extension to fix SQLBagOStuff duplicate warnings

Query this to check for SQLBagOStuff errors/warnings.
On staging:

error_groups.id="CLLJm-eviqOjaw"
logName:"stderr"
resource.type="k8s_container"
resource.labels.cluster_name="wbaas-2"
SEARCH("`[SQLBagOStuff]`")

On production:

error_groups.id="CLLJm-eviqOjaw"
logName:"stderr"
resource.type="k8s_container"
resource.labels.cluster_name="wbaas-3"
SEARCH("`[SQLBagOStuff]`")

These entries are the last [SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times warnings:
On staging:
https://console.cloud.google.com/logs/query;cursorTimestamp=2025-12-08T23:55:12.379857595Z;duration=P7D;query=SEARCH%2528%22%60%5BSQLBagOStuff%5D%60%22%2529%0Aresource.type%3D%22k8s_container%22%0Aresource.labels.cluster_name%3D%22wbaas-2%22%0Atimestamp%3D%222025-12-08T23:55:12.379857595Z%22%0AinsertId%3D%22ro27qwdnkcvtzuog%22?project=wikibase-cloud
On production:
https://console.cloud.google.com/logs/query;cursorTimestamp=2025-12-09T17:03:18.764700319Z;duration=P7D;query=SEARCH%2528%22%60%5BSQLBagOStuff%5D%60%22%2529%0Aresource.type%3D%22k8s_container%22%0Aresource.labels.cluster_name%3D%22wbaas-3%22%0Atimestamp%3D%222025-12-08T15:35:24.652140126Z%22%0AinsertId%3D%22k8ixwdcmjjgolfrx%22?project=wikibase-cloud

I also found different [SQLBagOStuff] warnings and errors in on production after running the above query. Here is the ticket for dedicated investigation: T412162