Page MenuHomePhabricator

Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy
Closed, ResolvedPublic3 Estimated Story Points

Description

The WikibaseTermboxInteraction schema was created in context of T211015 and we probably want to keep it until at least the new Termbox is available on Desktop, whenever that is.

Thus we should make sure it is migrated to the new platform.

For more context see the parent ticket.

(One of?) the Grafana boards with data from this schema https://grafana.wikimedia.org/d/000000018/eventlogging-schema?orgId=1&var-schema=WikibaseTermboxInteraction

  • 1. Pick a schema to migrate
  • 2. Create a new task to track this schema's migration
  • 3. Create /analytics/legacy/ schema
  • 4. Edit-protect the metawiki Schema page at https://meta.wikimedia.org/wiki/Schema:<SchemaName>
  • 5. Manually evolve the Hive table to use new schema
  • 6. Add entry to wgEventStreams, wgEventLoggingStreamNames and wgEventLoggingSchemas in operations/mediwiki-config
  • 7. Once the legacy stream's data is fully produced through EventGate, switch to using Refine job that uses schema repo instead of meta.wm.org
  • <waiting for deployment> 8. Edit the producer extension.json and set EventLoggingSchemas to the new schema URI
  • 9. Once the producer extension.json is fully deployed, edit wgEventLoggingSchemas in operations/mediawiki-config InitialiseSettings.php and remove the schema's entry.
  • 10. Mark the schema as migrated in the EventLogging Schema Migration Audit spreadsheet

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
odimitrijevic triaged this task as High priority.
odimitrijevic moved this task from Incoming to Event Platform on the Analytics board.

@Michael Hi!

I'm going to migrate this schema during the next couple weeks.
I need to askk you a couple questions about it.

  1. Do you need to collect IP or geocode information together with this schema? The legacy EventLogging system collects them by default. But in the new system we only collect them if necessary. Please, let me know!
  2. Is the instrumentation that generates this data in the front-end (JS)? Or is it in the back end (PHP)?

Cheers!

@Michael Hi!

I'm going to migrate this schema during the next couple weeks.
I need to askk you a couple questions about it.

  1. Do you need to collect IP or geocode information together with this schema? The legacy EventLogging system collects them by default. But in the new system we only collect them if necessary. Please, let me know!

I don't think so.

  1. Is the instrumentation that generates this data in the front-end (JS)? Or is it in the back end (PHP)?

As you can see from the only patch that is linked to the task mentioned in the description about the creation of this schema, it is tracked in the browser javascript with mw.track. Please see the linked task T211015 for more details.

Change 721010 had a related patch set uploaded (by Mforns; author: Mforns):

[schemas/event/secondary@master] Add WikibaseTermboxInteraction to analytics/legacy

https://gerrit.wikimedia.org/r/721010

Change 721010 merged by jenkins-bot:

[schemas/event/secondary@master] Add WikibaseTermboxInteraction to analytics/legacy

https://gerrit.wikimedia.org/r/721010

EChetty set the point value for this task to 3.Jun 30 2022, 5:05 PM

Change 812017 had a related patch set uploaded (by Mforns; author: Mforns):

[operations/mediawiki-config@master] Migrate WikibaseTermboxInteraction from EventLogging to EventGate on testwiki

https://gerrit.wikimedia.org/r/812017

Change 812017 merged by jenkins-bot:

[operations/mediawiki-config@master] Migrate WikibaseTermboxInteraction from EventLogging to EventGate on testwiki

https://gerrit.wikimedia.org/r/812017

Mentioned in SAL (#wikimedia-operations) [2022-07-07T20:55:42Z] <thcipriani@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:812017|Migrate WikibaseTermboxInteraction from EventLogging to EventGate on testwiki (T290303)]] (duration: 03m 12s)

Change 812897 had a related patch set uploaded (by Mforns; author: Mforns):

[operations/mediawiki-config@master] Migrate WikibaseTermboxInteraction from EventLogging to EventGate on all wikis

https://gerrit.wikimedia.org/r/812897

Change 812897 merged by jenkins-bot:

[operations/mediawiki-config@master] Migrate WikibaseTermboxInteraction from EventLogging to EventGate on all wikis

https://gerrit.wikimedia.org/r/812897

Mentioned in SAL (#wikimedia-operations) [2022-07-11T20:28:56Z] <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:812897|Migrate WikibaseTermboxInteraction from EventLogging to EventGate on all wikis (T290303)]] (duration: 02m 53s)

Change 813925 had a related patch set uploaded (by Mforns; author: Mforns):

[operations/puppet@production] Refine WikibaseTermboxInteraction schema using eventlogging_legacy job

https://gerrit.wikimedia.org/r/813925

Change 813925 merged by Ottomata:

[operations/puppet@production] Refine WikibaseTermboxInteraction schema using eventlogging_legacy job

https://gerrit.wikimedia.org/r/813925

Change 814192 had a related patch set uploaded (by Mforns; author: Mforns):

[mediawiki/extensions/Wikibase@master] Set default WikibaseTermboxInteraction version to Event Platform schema URI

https://gerrit.wikimedia.org/r/814192

mforns updated the task description. (Show Details)

Change 814192 merged by jenkins-bot:

[mediawiki/extensions/Wikibase@master] Set default WikibaseTermboxInteraction version to Event Platform schema URI

https://gerrit.wikimedia.org/r/814192

Change 818137 had a related patch set uploaded (by Phuedx; author: Phuedx):

[operations/mediawiki-config@master] Remove WikibaseTermboxInteraction $wgEventLoggingSchemas entry

https://gerrit.wikimedia.org/r/818137

Change 818137 merged by jenkins-bot:

[operations/mediawiki-config@master] Remove WikibaseTermboxInteraction $wgEventLoggingSchemas entry

https://gerrit.wikimedia.org/r/818137

Change 822395 had a related patch set uploaded (by Phuedx; author: Phuedx):

[operations/mediawiki-config@master] Revert "Revert "Remove WikibaseTermboxInteraction $wgEventLoggingSchemas entry""

https://gerrit.wikimedia.org/r/822395

I tested https://gerrit.wikimedia.org/r/818137 against the wrong wiki during deployment and it was (rightfully) reverted. I've queued up https://gerrit.wikimedia.org/r/822395 for deployment on Monday, 15th August and left a note to myself to test it against the correct wiki…

EChetty updated Other Assignee, added: mforns; removed: phuedx.
EChetty added a subscriber: mforns.

Change 822395 merged by jenkins-bot:

[operations/mediawiki-config@master] Revert "Revert "Remove WikibaseTermboxInteraction $wgEventLoggingSchemas entry""

https://gerrit.wikimedia.org/r/822395

Mentioned in SAL (#wikimedia-operations) [2022-08-15T13:08:36Z] <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e2772238003b797b1a8b18b4df0aa56f54132727: Revert "Revert "Remove WikibaseTermboxInteraction $wgEventLoggingSchemas entry"" (T290303) (duration: 03m 29s)