Page MenuHomePhabricator

eventlogging-processor should fail to produce schemas that have been migrated to Event Platform
Closed, ResolvedPublic


If not, the data produced into Kafka may not be properly refineable into Hive.

We just encountered this for an hour of SearchSatisfaction data, and had to manually fix.

Event Timeline

  • i think* this happens cause the clients are running an old version of the code prior to the changes, I wonder if all teh events are for domains we do not control
Milimetric moved this task from Incoming to Event Platform on the Analytics board.

Change 634314 had a related patch set uploaded (by Ottomata; owner: Ottomata):
[operations/puppet@production] eventlogging-processor - skip events for schemas that have been fully migrated to Event Platform

Change 634314 merged by Ottomata:
[operations/puppet@production] eventlogging-processor - skip events for schemas migrated to Event Platform

Mentioned in SAL (#wikimedia-analytics) [2020-10-19T14:40:02Z] <ottomata> restarted eventlogging-processor with filter to skip events already migrated to event platform - T262304