Issue (include links if applicable):
Logstash dashboard shows a high amount of EventGate validation errors for CX events: https://logstash.wikimedia.org/goto/2234659c7b149ebfc3c1d4695568e602
The error is '.translation_id' should be integer, '.translation_source_section' should be string, '.translation_target_section' should be string
Almost 27K events were affected by this error during the last 90 days.
What should have happened instead?:
There can be two scenarios why this might be happening (both should be checked for)
- Events for which these events are not relevant, for example, tab selection, and explicitly being set to null. For events which fields which are not relevant, they should not be set to null. Missing fields will be set to null during ingestion. Please see: Event_Platform/Schemas/Guidelines#Optional_/_Missing_fields
- Events for which these fields are applicable, but are null for some reason. For example, there are several dashboard_translation_continue events which have this errors as well. If someone is continuing a translation, I would expect those events to have a translation_id at least.
Also note: the spike in errors seems to have started during mid March, coinciding with the unified CX dashboard release to desktop.
QA Results - Log Stash
| AC | Status | Details |
|---|---|---|
| 1 | ✅ | T395415#10942742 |