Page MenuHomePhabricator
Create Task
Maniphest T431977

Suggested investigations: Events instrumented client-side are not emitted to event streams
Closed, ResolvedPublicBUG REPORT
Actions

Description

Steps to replicate the issue (include links if applicable):

  • Ensure your account has sufficient permissions to be able to see Suggested Investigations
  • Navigate to a contributions page for a user who's present in an SI case
  • Click on "SI cases" link in the subheader line

What happens?:
Instrumentation event is sent to the intake server and "202 Accepted" is returned, but the event is not present in the event streams.

What should have happened instead?:
The event should be emitted to the event stream.

Software version (on Special:Version page; skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):
This issue started in the week of June 8th, when the instrumentation was ported to mw.testKitchen, instead of mw.eventLog (T414572).

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
SI: Fix client side instrumentationMszwarcmediawiki/extensions/CheckUsermaster+14 -3
Revert^2 "SI: Fix client side instrumentation"Mszwarcmediawiki/extensions/CheckUserwmf/1.47.0-wmf.10+14 -3
Revert "SI: Fix client side instrumentation"Mszwarcmediawiki/extensions/CheckUserwmf/1.47.0-wmf.10+3 -14
SI: Fix client side instrumentationMszwarcmediawiki/extensions/CheckUserwmf/1.47.0-wmf.10+14 -3
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
Restricted Task
 ResolvedBUG REPORTSTranT431977 Suggested investigations: Events instrumented client-side are not emitted to event streams

Event Timeline

mszwarc created this task.Mon, Jul 13, 8:49 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMon, Jul 13, 8:49 AM
mszwarc claimed this task.Mon, Jul 13, 8:50 AM
mszwarc moved this task from Backlog to In progress on the Product Safety and Integrity (Sprint Venus Flytrap (Jun 29 - Jul 17)) board.
gerritbot added a comment.Mon, Jul 13, 9:17 AM

Change #1310017 had a related patch set uploaded (by Mszwarc; author: Mszwarc):

[mediawiki/extensions/CheckUser@master] SI: Fix client side instrumentation

https://gerrit.wikimedia.org/r/1310017

gerritbot added a project: Patch-For-Review.Mon, Jul 13, 9:17 AM
mszwarc added a parent task: Restricted Task.Mon, Jul 13, 9:19 AM
mszwarc moved this task from In progress to Needs review on the Product Safety and Integrity (Sprint Venus Flytrap (Jun 29 - Jul 17)) board.Mon, Jul 13, 9:59 AM
gerritbot added a comment.Mon, Jul 13, 10:04 AM

Change #1310027 had a related patch set uploaded (by Mszwarc; author: Mszwarc):

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] SI: Fix client side instrumentation

https://gerrit.wikimedia.org/r/1310027

gerritbot added a comment.Mon, Jul 13, 10:09 AM

Change #1310017 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] SI: Fix client side instrumentation

https://gerrit.wikimedia.org/r/1310017

ReleaseTaggerBot added a project: MW-1.47-notes (1.47.0-wmf.11; 2026-07-14).Mon, Jul 13, 11:00 AM
gerritbot added a comment.Mon, Jul 13, 11:09 AM

Change #1310027 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] SI: Fix client side instrumentation

https://gerrit.wikimedia.org/r/1310027

Stashbot added a comment.Mon, Jul 13, 11:09 AM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T11:09:38Z] <mszwarc@deploy2003> Started scap sync-world: Backport for [[gerrit:1310027|SI: Fix client side instrumentation (T431977)]]

gerritbot added a comment.Mon, Jul 13, 11:16 AM

Change #1310055 had a related patch set uploaded (by Mszwarc; author: Mszwarc):

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] Revert "SI: Fix client side instrumentation"

https://gerrit.wikimedia.org/r/1310055

gerritbot added a comment.Mon, Jul 13, 11:24 AM

Change #1310055 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] Revert "SI: Fix client side instrumentation"

https://gerrit.wikimedia.org/r/1310055

gerritbot added a comment.Mon, Jul 13, 11:27 AM

Change #1310058 had a related patch set uploaded (by Mszwarc; author: Mszwarc):

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] Revert^2 "SI: Fix client side instrumentation"

https://gerrit.wikimedia.org/r/1310058

ReleaseTaggerBot edited projects, added: MW-1.47-notes (1.47.0-wmf.10; 2026-07-07); removed: MW-1.47-notes (1.47.0-wmf.11; 2026-07-14).Mon, Jul 13, 12:00 PM
Stashbot added a comment.Mon, Jul 13, 12:03 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:03:53Z] <mszwarc@deploy2003> Started scap sync-world: Backport for [[gerrit:1310027|SI: Fix client side instrumentation (T431977)]]

Stashbot added a comment.Mon, Jul 13, 12:04 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:04:22Z] <mszwarc@deploy2003> sync-world aborted: Backport for [[gerrit:1310027|SI: Fix client side instrumentation (T431977)]] (duration: 00m 29s)

gerritbot added a comment.Mon, Jul 13, 12:07 PM

Change #1310058 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@wmf/1.47.0-wmf.10] Revert^2 "SI: Fix client side instrumentation"

https://gerrit.wikimedia.org/r/1310058

Stashbot added a comment.Mon, Jul 13, 12:07 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:07:50Z] <mszwarc@deploy2003> Started scap sync-world: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]]

Stashbot added a comment.Mon, Jul 13, 12:09 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:09:26Z] <mszwarc@deploy2003> mszwarc: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Mon, Jul 13, 12:15 PM

Mentioned in SAL (#wikimedia-operations) [2026-07-13T12:15:04Z] <mszwarc@deploy2003> Finished scap sync-world: Backport for [[gerrit:1310058|Revert^2 "SI: Fix client side instrumentation" (T431977)]] (duration: 07m 14s)

Maintenance_bot removed a project: Patch-For-Review.Mon, Jul 13, 12:31 PM
mszwarc closed this task as Resolved.Mon, Jul 13, 12:44 PM
mszwarc moved this task from Needs review to Done on the Product Safety and Integrity (Sprint Venus Flytrap (Jun 29 - Jul 17)) board.
OKryva-WMF reopened this task as Open.Tue, Jul 14, 8:06 AM
OKryva-WMF subscribed.

Testing the event, looks like the events are being sent in eventstream, but in the superset some of the fields are not filled in (filtering events by domain does not return results) and filtering by this event specifically also returns no results.

Filters used: meta."domain" = 'en.wikipedia.org' and action = 'link_click'

OKryva-WMF reassigned this task from mszwarc to STran.Tue, Jul 14, 8:06 AM
STran closed this task as Resolved.Tue, Jul 14, 1:58 PM

meta."domain" = 'en.wikipedia.org' and action = 'link_click'

Most of the events did not occur on enwiki. I don't see any current evidence of events being unexpectedly dropped.

I think this is working as expected. Events triggered this morning were observed in the stream, confirming the backport correctly set the schema version, and propagated into the data lake approximately 3 hours after they occurred with metadata as expected.

Closing this for now. It's difficult to debug without being present for the initial stream ingest and subsequent data lake propagation but if you see a series of events that suggest something odd is happening in either ingest or propagation, please re-open, preferably with screenshots and timestamps as this is an actively moving data pipeline.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits