There is a new version of the HTML diffs schema with major changes. The current HTML pipeline is using the old version and we need to make the changes needed for the new version.
This requires changes in mediawiki-event-enrichment, mediawiki-config and deployment-charts.
Task is done if:
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| HTML enrichment - upgrade schema | repos/data-engineering/mediawiki-event-enrichment!120 | javiermonton | feature/html-enrichment-upgrade-schema | main |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | Isaac | T293465 Edit Types Research | |||
| Open | AKhatun_WMF | T351225 Productionized Edit Types | |||
| Open | None | T378617 Update mwedittypes to handle HTML diffs | |||
| Open | None | T380874 Incremental HTML wiki content dataset to support "Who are moderators" | |||
| Open | AKhatun_WMF | T410940 WE1.5.3 Productize Data for Monthly Active Moderator Actions | |||
| Open | None | T291120 MediaWiki Event Carried State Transfer - Problem Statement | |||
| Open | Ottomata | T415158 Common event data model for data derived from parsed page revision html (and more!) | |||
| Open | JMonton-WMF | T360794 Event stream with latest revision HTML & parent revision HTML diff | |||
| Resolved | JMonton-WMF | T418467 Enrich "parent" HTML using diffs | |||
| Resolved | JMonton-WMF | T419258 Adatp HTML pipeline to the new diffs schema |
Change #1249217 had a related patch set uploaded (by JavierMonton; author: JavierMonton):
[operations/mediawiki-config@master] stream: mediawiki.page_html_content_change
javiermonton opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/120
HTML enrichment - upgrade schema
Change #1249959 had a related patch set uploaded (by JavierMonton; author: JavierMonton):
[operations/deployment-charts@master] stream: mw-page-html-content-change-enrich
Change #1249217 merged by jenkins-bot:
[operations/mediawiki-config@master] stream: mediawiki.page_html_content_change
Mentioned in SAL (#wikimedia-operations) [2026-03-11T09:01:33Z] <javiermonton@deploy2002> Started scap sync-world: Backport for [[gerrit:1249217|stream: mediawiki.page_html_content_change (T419258)]]
Mentioned in SAL (#wikimedia-operations) [2026-03-11T09:03:36Z] <javiermonton@deploy2002> javiermonton: Backport for [[gerrit:1249217|stream: mediawiki.page_html_content_change (T419258)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-03-11T09:10:01Z] <javiermonton@deploy2002> Finished scap sync-world: Backport for [[gerrit:1249217|stream: mediawiki.page_html_content_change (T419258)]] (duration: 08m 28s)
Change #1249959 merged by jenkins-bot:
[operations/deployment-charts@master] stream: mw-page-html-content-change-enrich
Change #1250523 had a related patch set uploaded (by JavierMonton; author: JavierMonton):
[operations/deployment-charts@master] stream: mw-page-html-content-change-enrich
Change #1250523 merged by jenkins-bot:
[operations/deployment-charts@master] stream: mw-page-html-content-change-enrich
javiermonton merged https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/120
HTML enrichment - upgrade schema