Update Schema Events
Closed, ResolvedPublic5 Estimated Story Points
Actions

Assigned To

Authored By

	JVanderhoop-WMF
	Oct 21 2025, 7:58 PM

Description

Schema Events
Repository: https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/tree/master/jsonschema/analytics/product_metrics

Update directory structure (product_metrics ~~[→ experimentation_lab] → test_kitchen~~ )
Update schema references
- Update base schemas in Test Kitchen UI (and related tests): https://gitlab.wikimedia.org/repos/data-engineering/mpic/-/blame/main/frontend/.env?ref_type=heads#L5
- Update base schemas in https://gitlab.wikimedia.org/repos/data-engineering/metrics-platform
- Update base schemas in https://gerrit.wikimedia.org/g/mediawiki/extensions/MetricsPlatform
- Update base schemas in https://gerrit.wikimedia.org/g/mediawiki/extensions/WikimediaEvents
Ensure backward compatibility for existing data

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Revert to `product_metrics` schemas and use `default` as the coordinator value	mediawiki/extensions/TestKitchen	wmf/1.46.0-wmf.10	+49 -49
	Revert to `product_metrics` schemas and use `default` as the coordinator value	mediawiki/extensions/TestKitchen	master	+49 -49

Customize query in gerrit

Related Changes in GitLab:

Title	Reference	Author	Source Branch	Dest Branch
Update Test Kitchen product_metrics schemas	repos/data-engineering/schemas-event-secondary!106	cjming	T407901/update-product-metrics-schemas	master
Revert "Merge branch 'T407901/rename-product-metrics-fragments' into 'master'"	repos/data-engineering/schemas-event-secondary!105	cjming	revert-914a8af4	master
Revert "Merge branch 'T407901/rename-product-metrics' into 'master'"	repos/data-engineering/schemas-event-secondary!104	cjming	revert-005bc79b	master
Update product_metrics schema fragments to test_kitchen	repos/data-engineering/schemas-event-secondary!103	cjming	T407901/rename-product-metrics-fragments	master

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T407803 [Epic] Rename Experimentation Lab/Experiment Platform to... Test Kitchen
		Resolved		cjming	T407901 Update Schema Events

Event Timeline

JVanderhoop-WMF created this task.Oct 21 2025, 7:58 PM

JVanderhoop-WMF removed a project: Epic.Oct 22 2025, 4:03 PM

JVanderhoop-WMF moved this task from Incoming to Renaming on the Test Kitchen board.Oct 28 2025, 4:54 PM

JVanderhoop-WMF triaged this task as Medium priority.Oct 28 2025, 4:55 PM

Milimetric edited projects, added Test Kitchen (Experiment Platform Sprint 16); removed Test Kitchen.Nov 25 2025, 4:32 PM

Sfaci updated the task description. (Show Details)Dec 2 2025, 2:31 PM

Sfaci updated the task description. (Show Details)

Sfaci updated the task description. (Show Details)Dec 2 2025, 2:44 PM

Sfaci updated the task description. (Show Details)Dec 2 2025, 2:49 PM

cjming claimed this task.Dec 3 2025, 3:00 AM

cjming moved this task from Ready for Development to In Progress on the Test Kitchen (Experiment Platform Sprint 16) board.

just verifying something here - do we want to replace product_metrics with test_kitchen in the secondary repo?
or do we want to have a subdirectory called test_kitchen within product_metrics?

i'm going to err on the former so someone let me know if it's actually the latter...

and does this task involve updating fragments too?
i.e. https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/tree/master/jsonschema/fragment/analytics/product_metrics?ref_type=heads
replace product_metrics in the directory structure with test_kitchen?

cc @JVanderhoop-WMF @Milimetric @KReid-WMF

cjming opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/102

Update product_metrics schemas to test_kitchen

cjming moved this task from In Progress to Needs Review on the Test Kitchen (Experiment Platform Sprint 16) board.Dec 11 2025, 3:24 AM

In T407901#11450040, @cjming wrote:

just verifying something here - do we want to replace product_metrics with test_kitchen in the secondary repo?
or do we want to have a subdirectory called test_kitchen within product_metrics?

I would say both are the same thing, right? The name of the schema is based on the directory structure (or vice versa). That replacement would imply to rename the corresponding subdirectory, so I would say what you decided to do is the right thing

and does this task involve updating fragments too?
i.e. https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/tree/master/jsonschema/fragment/analytics/product_metrics?ref_type=heads
replace product_metrics in the directory structure with test_kitchen?

cc @JVanderhoop-WMF @Milimetric @KReid-WMF

According to the same criterion above, I would say we should rename also the fragments (schemas + subdirectories)

cjming opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/103

Update product_metrics schema fragments to test_kitchen

sfaci merged https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/103

Update product_metrics schema fragments to test_kitchen

cjming set the point value for this task to 5.Dec 17 2025, 11:06 PM

KReid-WMF edited projects, added Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)); removed Test Kitchen (Experiment Platform Sprint 16).Dec 18 2025, 3:00 PM

KReid-WMF moved this task from Ready for Development to Needs Review on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)) board.

Sfaci moved this task from Needs Review to In Progress on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)) board.Dec 22 2025, 8:40 AM

cjming opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/105

Draft: Revert "Merge branch 'T407901/rename-product-metrics-fragments' into 'master'"

cjming updated https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/104

Draft: Revert "Merge branch 'T407901/rename-product-metrics' into 'master'"

Change #1223726 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[mediawiki/extensions/TestKitchen@master] Revert to `product_metrics` schemas

https://gerrit.wikimedia.org/r/1223726

cjming moved this task from In Progress to Needs Review on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)) board.Jan 7 2026, 10:50 PM

Per discussion in Slack and https://wikitech.wikimedia.org/wiki/User:Ottomata/Organized_Code#Avoid_casual_names, we are declining this ticket and keeping Test Kitchen schemas with its current naming convention product_metrics

updated docs to include reasoning behind naming convention - https://wikitech.wikimedia.org/wiki/Test_Kitchen/Schemas#Base_schemas

i will keep this ticket open until all the reverts are merged then move to done (or declined?)

In T407901#11505676, @cjming wrote:

Per discussion in Slack and https://wikitech.wikimedia.org/wiki/User:Ottomata/Organized_Code#Avoid_casual_names, we are declining this ticket and keeping Test Kitchen schemas with its current naming convention product_metrics

updated docs to include reasoning behind naming convention - https://wikitech.wikimedia.org/wiki/Test_Kitchen/Schemas#Base_schemas

i will keep this ticket open until all the reverts are merged then move to done (or declined?)

We could also transform this ticket into something that reflect the work we are going to do, right? New 2.0.0 version, default value for coordinator as a replacement for xlab, the comments where Experimentation Lab, xlab and others are mentioned, and the removal of experiments fragment. After all there are some schema work that needs to be done. Is not what we planned at the beginning but that work is somehow related to the renaming

We could also transform this ticket into something that reflect the work we are going to do, right? New 2.0.0 version, default value for coordinator as a replacement for xlab, the comments where Experimentation Lab, xlab and others are mentioned, and the removal of experiments fragment. After all there are some schema work that needs to be done. Is not what we planned at the beginning but that work is somehow related to the renaming

good point - ok repurposing ticket accordingly

cjming renamed this task from Rename Schema Events to Update Schema Events.Jan 9 2026, 6:35 PM

cjming updated the task description. (Show Details)

cjming opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/106

Update Test Kitchen product_metrics schemas

sfaci merged https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/106

Update Test Kitchen product_metrics schemas

Change #1223726 merged by jenkins-bot:

[mediawiki/extensions/TestKitchen@master] Revert to `product_metrics` schemas and use `default` as the coordinator value

https://gerrit.wikimedia.org/r/1223726

Change #1225675 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[mediawiki/extensions/TestKitchen@wmf/1.46.0-wmf.10] Revert to `product_metrics` schemas and use `default` as the coordinator value

https://gerrit.wikimedia.org/r/1225675

Change #1225675 abandoned by Clare Ming:

[mediawiki/extensions/TestKitchen@wmf/1.46.0-wmf.10] Revert to `product_metrics` schemas and use `default` as the coordinator value

Reason:

wrong revert

https://gerrit.wikimedia.org/r/1225675

Change #1225675 restored by Clare Ming:

[mediawiki/extensions/TestKitchen@wmf/1.46.0-wmf.10] Revert to `product_metrics` schemas and use `default` as the coordinator value

https://gerrit.wikimedia.org/r/1225675

Sfaci moved this task from Needs Review to In Progress on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)) board.Jan 12 2026, 10:06 PM

Sfaci moved this task from In Progress to Needs Review on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)) board.Jan 12 2026, 10:08 PM

Change #1225675 merged by jenkins-bot:

[mediawiki/extensions/TestKitchen@wmf/1.46.0-wmf.10] Revert to `product_metrics` schemas and use `default` as the coordinator value

https://gerrit.wikimedia.org/r/1225675

Mentioned in SAL (#wikimedia-operations) [2026-01-12T23:14:36Z] <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1225675|Revert to product_metrics schemas and use default as the coordinator value (T407901)]]

Mentioned in SAL (#wikimedia-operations) [2026-01-12T23:16:26Z] <cjming@deploy2002> cjming: Backport for [[gerrit:1225675|Revert to product_metrics schemas and use default as the coordinator value (T407901)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-01-12T23:20:49Z] <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1225675|Revert to product_metrics schemas and use default as the coordinator value (T407901)]] (duration: 06m 13s)