Implement a system to send EventLogging validation logs into Logstash to enable easy troubleshooting for non-analytics users.
When developing new schemas for EventLogging, non-analytics schema owners have difficulties in checking if the events generated by their new instrumentation are indeed correct, or have validation problems. That is so, because they don't have access to eventlog1001.eqiad.wmnet, where the validation logs live (for security reasons). This results in unnecessary email ping-pong between the schema owners (who can not see the logs) and analytics developers (who can not modify the instrumentation code).
Modify the EventLogging code to additionally send the validation logs into Logstash in real time. Thus, the non-analytics developers will be able to instantly debug their instrumentation by accessing Logstash. Both their team and analytics will save considerable time.
research what is the best option:
- consuming the kafka topic directly from logstash
- sending events to logstash from a new EL writer
Testing on analytics1004.eqiad.wmnet