[Epic] Verification of Experimentation Lab Closed Beta capabilities
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	mpopov
	Jun 18 2025, 1:54 PM

Description

To verify all the capabilities we have in Closed Beta:

Conduct a set of 3 A/A tests:
- 1 test using edge unique-based enrollment and data collected with JS SDK
- 2 tests using MW user-based enrollment
  - 1 test having data collected with JS SDK
  - 1 test having data collected with PHP SDK
- all 3 are configured in xLab UI
- all 3 are analyzed automatically
Configure an instrument in xLab UI

Related Objects
Search...

Status	Assigned	Task
Resolved	JVanderhoop-WMF	T397337 [Epic] Verification of Experimentation Lab Closed Beta capabilities
Resolved	phuedx	T397138 Run a second synthetic A/A test
Resolved	None	T397140 Run a logged-in synthetic A/A test using the JS SDK
Resolved	Sfaci	T397143 Run a logged-in synthetic A/A test using the PHP SDK
Resolved	cjming	T397144 MetricsPlatform: Enable experiment config fetching
Resolved	cjming	T397363 Verify instrument configuration with xLab
Resolved	JVanderhoop-WMF	T398480 [Epic] Update instruments configuration for xLab
Resolved	phuedx	T398422 MetricsPlatform: InstrumentConfigFetcher: Make fetching asynchronous
Resolved	phuedx	T386912 InstrumentConfigFetcher fails when wgMetricsPlatformInstrumentConfiguratorBaseUrl is set with a URL that is a redirect
Resolved	phuedx	T398957 MetricsPlatform: InstrumentConfigsFetcher: Set User-Agent header
Resolved	Sfaci	T399292 MetricsPlatform: Filter inactive instrument and experiment configs
Declined	phuedx	T401379 Make MetricsClient accept instrument configs
Resolved	phuedx	T401380 MetricsPlatform: Initialize MetricsClient with instrument configs fetched from xLab

Event Timeline

mpopov created this task.Jun 18 2025, 1:54 PM

mpopov triaged this task as Medium priority.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 18 2025, 1:54 PM

mpopov added subtasks: T397138: Run a second synthetic A/A test, T397140: Run a logged-in synthetic A/A test using the JS SDK, T397143: Run a logged-in synthetic A/A test using the PHP SDK.Jun 18 2025, 1:54 PM

mpopov moved this task from Ready for Development to Sprint Goals & Active Epics on the Test Kitchen (Experiment Platform Sprint 8) board.

mpopov renamed this task from [Epic] Verification of Experimentation Lab capabilities to [Epic] Verification of Experimentation Lab Closed Beta capabilities.Jun 18 2025, 2:14 PM

mpopov updated the task description. (Show Details)

mpopov updated the task description. (Show Details)Jun 18 2025, 7:09 PM

Milimetric closed subtask T397138: Run a second synthetic A/A test as Resolved.Jun 30 2025, 3:07 PM

Milimetric moved this task from Sprint Goals & Active Epics to Done on the Test Kitchen (Experiment Platform Sprint 8) board.Jul 8 2025, 2:09 PM

Milimetric moved this task from Done to Sprint Goals & Active Epics on the Test Kitchen (Experiment Platform Sprint 8) board.

Milimetric edited projects, added Test Kitchen (Experiment Platform Sprint 9); removed Test Kitchen (Experiment Platform Sprint 8).

Milimetric moved this task from Ready for Development to Sprint Goals & Active Epics on the Test Kitchen (Experiment Platform Sprint 9) board.

Milimetric edited projects, added Test Kitchen (Experiment Platform Sprint 10); removed Test Kitchen (Experiment Platform Sprint 9).Jul 24 2025, 1:56 PM

Milimetric moved this task from Ready for Development to Sprint Goals & Active Epics on the Test Kitchen (Experiment Platform Sprint 10) board.

Milimetric closed subtask T397140: Run a logged-in synthetic A/A test using the JS SDK as Resolved.Aug 11 2025, 3:13 PM

Milimetric edited projects, added Test Kitchen (Experiment Platform Sprint 11); removed Test Kitchen (Experiment Platform Sprint 10).Aug 18 2025, 2:55 PM

Milimetric moved this task from Ready for Development to Sprint Goals & Active Epics on the Test Kitchen (Experiment Platform Sprint 11) board.