Page MenuHomePhabricator

Implement Suggestion Mode instrumentation spec in Test Kitchen
Closed, ResolvedPublic

Description

This task involves the work of ensuring that all events defined within the WE 1.7 Edit Suggestions Instrumentation Spec are implemented within Test Kitchen.

Requirements

  1. Review all events defined in Column D (Relevant VEFU/EAS Fields) of the WE 1.7 Edit Suggestions Instrumentation Spec
  2. For any events defined in Column D that are not implemented within Column E (Test Kitchen Interaction Fields (will only be needed if we use TestKitchen)), propose names for these events, and implement them
    • Question: where does this implementation happen?

Done

  • All specified events are implemented both within VEFU and Test Kitchen
  • @MNeisler or @mpopov review proposed implementation

Event Timeline

ppelberg triaged this task as High priority.

we cannot estimate this. David L is the one usually working with testkitchen.

Caro will have a look and work with David L.

I've gotten context from David L and will begin working on this!

Change #1272741 had a related patch set uploaded (by Medelius; author: Medelius):

[mediawiki/extensions/WikimediaEvents@master] WIP: Add experiment for suggestion mode beta feature

https://gerrit.wikimedia.org/r/1272741

Change #1275510 had a related patch set uploaded (by Medelius; author: Medelius):

[mediawiki/extensions/VisualEditor@master] Suggestion mode controlled experiment: check assigned group

https://gerrit.wikimedia.org/r/1275510

Next steps

Per today's offline discussion...

  • 1. @medelius to talk with @DLynch to:
    • Decide what (if anything) about the proposed implementation needs revision/adjustment
    • If changes are needed, decide who will implement them and when and who will backport them

Change #1275510 abandoned by Medelius:

[mediawiki/extensions/VisualEditor@master] Suggestion mode controlled experiment: use treatment group config

Reason:

We're just going to enable the beta feature from the experiment code in 1272741.

https://gerrit.wikimedia.org/r/1275510

Change #1272741 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add experiment for suggestion mode beta feature

https://gerrit.wikimedia.org/r/1272741

Change #1277496 had a related patch set uploaded (by Esanders; author: Medelius):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.24] Add experiment for suggestion mode beta feature

https://gerrit.wikimedia.org/r/1277496

Change #1277496 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.24] Add experiment for suggestion mode beta feature

https://gerrit.wikimedia.org/r/1277496

Mentioned in SAL (#wikimedia-operations) [2026-04-27T13:46:41Z] <esanders@deploy1003> Started scap sync-world: Backport for [[gerrit:1277496|Add experiment for suggestion mode beta feature (T422740)]]

Mentioned in SAL (#wikimedia-operations) [2026-04-27T13:48:15Z] <esanders@deploy1003> esanders: Backport for [[gerrit:1277496|Add experiment for suggestion mode beta feature (T422740)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-04-27T13:54:08Z] <esanders@deploy1003> Finished scap sync-world: Backport for [[gerrit:1277496|Add experiment for suggestion mode beta feature (T422740)]] (duration: 07m 26s)

Change #1277571 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/WikimediaEvents@master] Backwards compatibility for mw.testKitchen.compat (ironically)

https://gerrit.wikimedia.org/r/1277571

Change #1277572 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.24] Backwards compatibility for mw.testKitchen.compat (ironically)

https://gerrit.wikimedia.org/r/1277572

Change #1277571 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Backwards compatibility for mw.testKitchen.compat (ironically)

https://gerrit.wikimedia.org/r/1277571

Change #1277572 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.24] Backwards compatibility for mw.testKitchen.compat (ironically)

https://gerrit.wikimedia.org/r/1277572

Mentioned in SAL (#wikimedia-operations) [2026-04-27T15:44:45Z] <kemayo@deploy1003> Started scap sync-world: Backport for [[gerrit:1277572|Backwards compatibility for mw.testKitchen.compat (ironically) (T422740)]]

Mentioned in SAL (#wikimedia-operations) [2026-04-27T15:46:25Z] <kemayo@deploy1003> kemayo: Backport for [[gerrit:1277572|Backwards compatibility for mw.testKitchen.compat (ironically) (T422740)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-04-27T16:00:42Z] <kemayo@deploy1003> Finished scap sync-world: Backport for [[gerrit:1277572|Backwards compatibility for mw.testKitchen.compat (ironically) (T422740)]] (duration: 15m 57s)

@medelius: to be doubly sure, would it be accurate for me to think Megan and Mikhail have review the proposed implementation?

Mikhail did a code review pass, so I think we could say that?

Mikhail did a code review pass, so I think we could say that?

Sounds great. Thank you for confirming, Caro.