Support event logging propagation from target to deployment host
Closed, ResolvedPublic

Description

Our grand logging vision comprises multiple logging outputs on the deployment host (different tmux windows, logstash, etc.) and varying levels of filtration.

The only way we can differentiate log events from the remote deploy-local command is to maintain the event structure between hosts. Our idea is to implement a line-wise JSON serializer/deserializer on the target/host (deploy-local/deploy) sides respectively. Upon deserializing each line of remote output, the job executor of deploy will inject the structured log event into the local logging stream with host-specific context, allowing for downstream filtering, propagation, etc.

dduvall created this task.Sep 18 2015, 7:15 PM
dduvall updated the task description. (Show Details)
dduvall raised the priority of this task from to Normal.
dduvall added a project: Scap.
dduvall added a subscriber: dduvall.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 18 2015, 7:15 PM
dduvall moved this task from Needs triage to Services MVP on the Scap board.Sep 18 2015, 7:16 PM
dduvall claimed this task.Sep 18 2015, 7:18 PM
dduvall set Security to None.
dduvall added subscribers: mmodell, thcipriani, demon.

Change 241074 had a related patch set uploaded (by Dduvall):
Propagate structured logging from target to deploy host

https://gerrit.wikimedia.org/r/241074

dduvall moved this task from Services MVP to Done on the Scap board.Sep 25 2015, 4:50 PM
dduvall moved this task from Done to Services MVP on the Scap board.

Change 241074 merged by jenkins-bot:
Propagate structured logging from target to deploy host

https://gerrit.wikimedia.org/r/241074

dduvall closed this task as Resolved.Sep 25 2015, 6:19 PM
dduvall moved this task from Services MVP to Done on the Scap board.