Page MenuHomePhabricator

Support event logging propagation from target to deployment host
Closed, ResolvedPublic

Description

Our grand logging vision comprises multiple logging outputs on the deployment host (different tmux windows, logstash, etc.) and varying levels of filtration.

The only way we can differentiate log events from the remote deploy-local command is to maintain the event structure between hosts. Our idea is to implement a line-wise JSON serializer/deserializer on the target/host (deploy-local/deploy) sides respectively. Upon deserializing each line of remote output, the job executor of deploy will inject the structured log event into the local logging stream with host-specific context, allowing for downstream filtering, propagation, etc.

Event Timeline

dduvall raised the priority of this task from to Medium.
dduvall updated the task description. (Show Details)
dduvall added a project: Scap.
dduvall added a subscriber: dduvall.
dduvall set Security to None.
dduvall added subscribers: mmodell, thcipriani, demon.

Change 241074 had a related patch set uploaded (by Dduvall):
Propagate structured logging from target to deploy host

https://gerrit.wikimedia.org/r/241074

dduvall moved this task from Done to Services MVP on the Scap board.

Change 241074 merged by jenkins-bot:
Propagate structured logging from target to deploy host

https://gerrit.wikimedia.org/r/241074

dduvall moved this task from Services MVP to Done on the Scap board.