Page MenuHomePhabricator

⬆️ Investigate SQLBagOStuff Duplicate get error
Closed, ResolvedPublic

Description

Investigate

[SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times

from https://console.cloud.google.com/errors/detail/CLLJm-eviqOjaw;time=P7D;locations=global?project=wikibase-cloud

Extracted from T408101: ⬆️ Investigate Expectation (masterConns <= 0) errors

I think I dug up this ticket T237143 as relevant to

[SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times

Seems like the solution temporarily is to silence it; or to wait until 1.44+ where there is a fix. An example of how to silence (but for a different cache type) can be seen at https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/552257/3/wmf-config/CommonSettings.php

Event Timeline

Tarrow renamed this task from Investigate SQLBagOStuff Duplicate get error to ⬆️ Investigate SQLBagOStuff Duplicate get error.
Tarrow updated the task description. (Show Details)

dati18 opened https://github.com/wbstack/mediawiki/pull/500

Add patchUrl to Echo extension to fix SQLBagOStuff duplicate warnings

@Ollie.Shotton_WMDE and I decided to backport the Echo patch to fix the SQLBagOStuff duplicate warnings

dang removed dang as the assignee of this task.Dec 9 2025, 11:34 AM
dang moved this task from Doing to Waiting for Peer Review on the Wikibase Cloud (Kanban Board) board.
dang subscribed.

dati18 closed https://github.com/wbstack/mediawiki/pull/500

Add patchUrl to Echo extension to fix SQLBagOStuff duplicate warnings

Query this to check for SQLBagOStuff errors/warnings.
On staging:

error_groups.id="CLLJm-eviqOjaw"
logName:"stderr"
resource.type="k8s_container"
resource.labels.cluster_name="wbaas-2"
SEARCH("`[SQLBagOStuff]`")

On production:

error_groups.id="CLLJm-eviqOjaw"
logName:"stderr"
resource.type="k8s_container"
resource.labels.cluster_name="wbaas-3"
SEARCH("`[SQLBagOStuff]`")

These entries are the last [SQLBagOStuff] Duplicate get(): "mwdb_f036984f01-mwt_93f623752b_:echo:seen:message:time:1" fetched 2 times warnings:
On staging:
https://console.cloud.google.com/logs/query;cursorTimestamp=2025-12-08T23:55:12.379857595Z;duration=P7D;query=SEARCH%2528%22%60%5BSQLBagOStuff%5D%60%22%2529%0Aresource.type%3D%22k8s_container%22%0Aresource.labels.cluster_name%3D%22wbaas-2%22%0Atimestamp%3D%222025-12-08T23:55:12.379857595Z%22%0AinsertId%3D%22ro27qwdnkcvtzuog%22?project=wikibase-cloud
On production:
https://console.cloud.google.com/logs/query;cursorTimestamp=2025-12-09T17:03:18.764700319Z;duration=P7D;query=SEARCH%2528%22%60%5BSQLBagOStuff%5D%60%22%2529%0Aresource.type%3D%22k8s_container%22%0Aresource.labels.cluster_name%3D%22wbaas-3%22%0Atimestamp%3D%222025-12-08T15:35:24.652140126Z%22%0AinsertId%3D%22k8ixwdcmjjgolfrx%22?project=wikibase-cloud

I also found different [SQLBagOStuff] warnings and errors in on production after running the above query. Here is the ticket for dedicated investigation: T412162

Tarrow claimed this task.