Page MenuHomePhabricator
Create Task
Maniphest T430322

[EventGate] Record metrics for instruments and experiments
Open, HighPublic5 Estimated Story Points
Actions

Description

Background

As well as the number of events flowing on streams, the Experiment Platform team would like to know whether those events were produced by Test Kitchen instruments or experiments.

AC

  • Increment a counter when an event has the instrument_name field set and label the counter with the value
  • Increment a counter when an event has the experiment.enrolled field set and label the counter with the value

Notes

  1. In order to keep the cardinality of the counters to a minimum, we should validate the instrument and experiment names prior to incrementing the counters

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
[eventgate] Bump to v1.33.0Phuedxoperations/deployment-chartsmaster+4 -4
eventgate-analytics-external: Enable testKitchen transformPhuedxoperations/deployment-chartsmaster+5 -0
EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streamsPhuedxoperations/mediawiki-configmaster+5 -2
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
transforms/testKitchen: use experiment.enrolled for the experiment_name labelrepos/data-engineering/eventgate-wikimedia!37phuedxwork/phuedx/T430322master
Customize query in GitLab

Related Objects
Search...

Event Timeline

phuedx created this task.Jun 26 2026, 2:26 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 26 2026, 2:26 PM
mpopov subscribed.Jun 29 2026, 2:28 PM

In order to keep the cardinality of the counters to a minimum, we should validate the instrument and experiment names prior to incrementing the counters

Now captured in T430541: [EventGate] Reject events from inactive instruments and experiments

JVanderhoop-WMF subscribed.Jun 30 2026, 4:30 PM

This would enable TK users to self-serve in answering the question "are events coming in for my experiment/instrument?"

JVanderhoop-WMF triaged this task as High priority.Jun 30 2026, 4:40 PM
JVanderhoop-WMF moved this task from Incoming to READY TO GROOM on the Test Kitchen board.Jul 7 2026, 4:37 PM
JVanderhoop-WMF added a project: Essential-Work.
KReid-WMF edited projects, added: Test Kitchen (Experiment Platform Sprint 27); removed: Test Kitchen.Jul 16 2026, 4:01 PM
KReid-WMF set the point value for this task to 5.
phuedx claimed this task.Tue, Jul 21, 1:27 PM
phuedx moved this task from Ready for Development to Needs Review on the Test Kitchen (Experiment Platform Sprint 27) board.
Ottomata moved this task from Incoming (new tickets) to Tag with Radar on the Data-Engineering board.Wed, Jul 29, 1:41 PM
Ottomata added a project: Data-Engineering-Radar.
CodeReviewBot added a comment.Thu, Jul 30, 3:15 PM

phuedx updated https://gitlab.wikimedia.org/repos/data-engineering/eventgate-wikimedia/-/merge_requests/35

Add TestKitchen transform

KReid-WMF edited projects, added: Test Kitchen (Experiment Platform Sprint 28); removed: Test Kitchen (Experiment Platform Sprint 27).Thu, Aug 6, 8:21 PM
KReid-WMF moved this task from Ready for Development to Needs Review on the Test Kitchen (Experiment Platform Sprint 28) board.
phuedx added a subtask: T407642: Write a Decision Brief for creating an TK-aware EventGate instance.Fri, Aug 7, 9:12 AM
CodeReviewBot added a comment.Fri, Aug 7, 1:36 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/eventgate-wikimedia/-/merge_requests/35

Add TestKitchen transform

phuedx moved this task from Needs Review to To Deploy on the Test Kitchen (Experiment Platform Sprint 28) board.Fri, Aug 7, 5:53 PM
gerritbot added a comment.Wed, Aug 12, 1:46 PM

Change #1324725 had a related patch set uploaded (by Phuedx; author: Phuedx):

[operations/mediawiki-config@master] EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streams

https://gerrit.wikimedia.org/r/1324725

gerritbot added a project: Patch-For-Review.Wed, Aug 12, 1:46 PM
gerritbot added a comment.Wed, Aug 12, 1:52 PM

Change #1324728 had a related patch set uploaded (by Phuedx; author: Phuedx):

[operations/deployment-charts@master] eventgate-analytics-external: Enable testKitchen transform

https://gerrit.wikimedia.org/r/1324728

gerritbot added a comment.Mon, Aug 17, 8:20 AM

Change #1324725 merged by jenkins-bot:

[operations/mediawiki-config@master] EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streams

https://gerrit.wikimedia.org/r/1324725

Stashbot mentioned this in T429898: [EventGate] Add configurable UA denylist.Mon, Aug 17, 8:21 AM

Mentioned in SAL (#wikimedia-operations) [2026-08-17T08:21:15Z] <phuedx@deploy1003> Started scap sync-world: Backport for [[gerrit:1324725|EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streams (T429898 T430322)]], [[gerrit:1313923|EventStreamConfig: Remove unused web_ui_scroll* streams (T415370)]], [[gerrit:rMW132554684a48|EventStreamConfig: Remove Watchlist click stream (T434790)]]

Stashbot mentioned this in T434790: Decommission Watchlist CTR baseline data.Mon, Aug 17, 8:21 AM
Stashbot mentioned this in T415370: Migrate all instruments using mw.eventLog.submitInteraction to mw.testKitchen.getInstrument().

Mentioned in SAL (#wikimedia-operations) [2026-08-17T08:23:09Z] <phuedx@deploy1003> bearloga, phuedx: Backport for [[gerrit:1324725|EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streams (T429898 T430322)]], [[gerrit:1313923|EventStreamConfig: Remove unused web_ui_scroll* streams (T415370)]], [[gerrit:rMW132554684a48|EventStreamConfig: Remove Watchlist click stream (T434790)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug

Stashbot added a comment.Mon, Aug 17, 8:34 AM

Mentioned in SAL (#wikimedia-operations) [2026-08-17T08:33:57Z] <phuedx@deploy1003> Finished scap sync-world: Backport for [[gerrit:1324725|EventStreamConfig: Mark product_metrics.web_base and .web_base_with_ip as Test Kitchen streams (T429898 T430322)]], [[gerrit:1313923|EventStreamConfig: Remove unused web_ui_scroll* streams (T415370)]], [[gerrit:rMW132554684a48|EventStreamConfig: Remove Watchlist click stream (T434790)]] (duration: 12m 42s)

gerritbot added a comment.Mon, Aug 17, 1:44 PM

Change #1324728 merged by jenkins-bot:

[operations/deployment-charts@master] eventgate-analytics-external: Enable testKitchen transform

https://gerrit.wikimedia.org/r/1324728

CodeReviewBot added a comment.Mon, Aug 17, 2:29 PM

phuedx opened https://gitlab.wikimedia.org/repos/data-engineering/eventgate-wikimedia/-/merge_requests/37

transforms/testKitchen: use experiment.enrolled for the experiment_name label

CodeReviewBot added a comment.Mon, Aug 17, 2:41 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/eventgate-wikimedia/-/merge_requests/37

transforms/testKitchen: use experiment.enrolled for the experiment_name label

gerritbot added a comment.Mon, Aug 17, 3:24 PM

Change #1326314 had a related patch set uploaded (by Phuedx; author: Phuedx):

[operations/deployment-charts@master] [eventgate] Bump to v1.33.0

https://gerrit.wikimedia.org/r/1326314

phuedx updated the task description. (Show Details)Mon, Aug 17, 3:29 PM
gerritbot added a comment.Mon, Aug 17, 4:07 PM

Change #1326314 merged by jenkins-bot:

[operations/deployment-charts@master] [eventgate] Bump to v1.33.0

https://gerrit.wikimedia.org/r/1326314

phuedx updated the task description. (Show Details)Mon, Aug 17, 4:29 PM
phuedx moved this task from To Deploy to Done on the Test Kitchen (Experiment Platform Sprint 28) board.Tue, Aug 18, 3:24 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits