Page MenuHomePhabricator

EchoMail and EchoInteraction Event Platform Migration
Closed, ResolvedPublic

Description

See: https://wikitech.wikimedia.org/wiki/Event_Platform/EventLogging_legacy Unless otherwise notified, client IP and consequently geocoded data will no longer be collected for this event data after this migration. Please let us know if this should continue to be captured. See also T262626.

  • 1. Pick a schema to migrate
  • 2. Create a new task to track this schema's migration
  • 3. Create /analytics/legacy/ schema
  • 4. Edit-protect the metawiki Schema page at https://meta.wikimedia.org/wiki/Schema:<SchemaName>
  • 5. Manually evolve the Hive table to use new schema
  • 6. Add entry to wgEventStreams, wgEventLoggingStreamNames and wgEventLoggingSchemas in operations/mediwiki-config
  • 7. Once the legacy stream's data is fully produced through EventGate, switch to using Refine job that uses schema repo instead of meta.wm.org
  • 8. Edit the producer extension.json and set EventLoggingSchemas to the new schema URI
  • 9. Once the producer extension.json is fully deployed, edit wgEventLoggingSchemas in operations/mediawiki-config InitialiseSettings.php and remove the schema's entry.
  • 10. Mark the schema as migrated in the EventLogging Schema Migration Audit spreadsheet

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

@nettrom_WMF @MMiller_WMF Do either EchoMail or EchoInteraction need client_ip and/or geocoded data?

Change 706742 had a related patch set uploaded (by Ottomata; author: Ottomata):

[schemas/event/secondary@master] Add legacy/echomail and legacy/echointeraction schemas

https://gerrit.wikimedia.org/r/706742

odimitrijevic moved this task from Incoming to Event Platform on the Analytics board.

@nettrom_WMF @MMiller_WMF Do either EchoMail or EchoInteraction need client_ip and/or geocoded data?

My understanding is that we're keeping these schemas in order to measure Echo usage, but we do not have a current project aimed at using that data. While we've filed T287121, I don't think EchoMail and EchoInteraction need IP or geocoded data at this point, and would proceed without it.

@MMiller_WMF: could you review this and let me know if my understanding isn't correct, or if there's a clear need for geocoded data in these schemas?

That is correct -- we do not need geocoded data for those schemas.

Change 706742 merged by jenkins-bot:

[schemas/event/secondary@master] Add legacy/echomail and legacy/echointeraction schemas

https://gerrit.wikimedia.org/r/706742

Change 708331 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] Migrate EchoMail and EchoInteraction to EventGate

https://gerrit.wikimedia.org/r/708331

Change 708331 merged by Ottomata:

[operations/mediawiki-config@master] Migrate EchoMail and EchoInteraction to EventGate

https://gerrit.wikimedia.org/r/708331

Mentioned in SAL (#wikimedia-operations) [2021-07-27T18:49:54Z] <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Migrate EchoMail and EchoInteraction to EventGate - T287210 (duration: 02m 28s)

Change 708332 had a related patch set uploaded (by Ottomata; author: Ottomata):

[mediawiki/extensions/Echo@master] Finalize migration of EchoMail and EchoInteraction to Event Platform

https://gerrit.wikimedia.org/r/708332

Change 708332 merged by jenkins-bot:

[mediawiki/extensions/Echo@master] Finalize migration of EchoMail and EchoInteraction to Event Platform

https://gerrit.wikimedia.org/r/708332

Change 714794 had a related patch set uploaded (by Mforns; author: Mforns):

[operations/mediawiki-config@master] Finalize Event Platform migration of EchoEmail and EchoInteraction

https://gerrit.wikimedia.org/r/714794

Change 714794 merged by jenkins-bot:

[operations/mediawiki-config@master] Finalize Event Platform migration of EchoEmail and EchoInteraction

https://gerrit.wikimedia.org/r/714794

Mentioned in SAL (#wikimedia-operations) [2021-08-26T18:03:51Z] <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: d4340e9c18468d14885c8ced87f1e014a3481f2a: Finalize Event Platform migration of EchoEmail and EchoInteraction (T287210) (duration: 01m 07s)

mforns moved this task from Ready to Deploy to Done on the Analytics-Kanban board.