Page MenuHomePhabricator

Provide a means of shipping logs from Docker-run services in Beta to logstash
Closed, ResolvedPublic

Description

Ideas from @Majavah :

10:08:40	<@taavi>	ori: I wonder if one could update role::beta::docker_services to send everything from /var/lib/docker/containers/*/*-json.log to rsyslog
10:08:56	<@taavi>	or configure docker to send logs to rsyslog directly https://docs.docker.com/config/containers/logging/configure/

Event Timeline

Change 800261 had a related patch set uploaded (by Ori; author: Ori):

[operations/puppet@production] profile: send function-{orchestrator,evaluator} logs to kafka/logstash

https://gerrit.wikimedia.org/r/800261

Change 800261 abandoned by Ori:

[operations/puppet@production] profile: send function-{orchestrator,evaluator} logs to kafka/logstash

Reason:

This isn't the right approach. A good solution to this issue will work out of the box for other services. It should match https://wikitech.wikimedia.org/wiki/Kubernetes/Logging.

https://gerrit.wikimedia.org/r/800261

Change 800282 had a related patch set uploaded (by Ori; author: Ori):

[operations/puppet@production] Beta Cluster: ship logs from docker services to logstash

https://gerrit.wikimedia.org/r/800282

Change 800282 merged by Giuseppe Lavagetto:

[operations/puppet@production] Beta Cluster: ship logs from docker services to logstash

https://gerrit.wikimedia.org/r/800282

ori claimed this task.