Page MenuHomePhabricator
Create Task
Maniphest T257861

Pipe SAL entries into Logstash
Closed, ResolvedPublic
Actions

Description

SAL is one of the more useful data streams to have as annotations in Grafana. These annotations are intended to be one output of the logging pipeline T222826.

At this time, SAL logs are not written to the production logging pipeline.

This task is to find a way to pipe the stream of SAL entries into the production logging pipeline.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
logstash: add tcpircbot logging testsoperations/puppetproduction+123 -0
logstash: duplicate sal logs to Lokioperations/puppetproduction+101 -0
tcpircbot: send !log events to log streamoperations/puppetproduction+18 -0
tcpircbot: send tcpircbot logs to centralized loggingoperations/puppetproduction+3 -1
tcpircbot: add and enable ecs logging handleroperations/puppetproduction+43 -8
Customize query in gerrit

Related Objects
Search...

Event Timeline

colewhite created this task.Jul 13 2020, 5:18 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 13 2020, 5:18 PM
colewhite triaged this task as Low priority.Jul 13 2020, 5:19 PM
colewhite added a parent task: T222826: Leverage Grafana annotations to show events in graphs.
fgiunchedi moved this task from Inbox to Backlog on the observability board.Jul 20 2020, 12:56 PM
• lmata edited projects, added SRE Observability; removed observability.Jul 12 2021, 2:21 AM
• lmata moved this task from Inbox to Backlog on the SRE Observability board.Jul 15 2021, 4:09 AM
• lmata edited projects, added Observability-Logging; removed SRE Observability.Aug 9 2021, 2:38 AM
colewhite moved this task from Inbox to Backlog on the Observability-Logging board.Jul 26 2022, 9:12 PM
colewhite changed the task status from Open to In Progress.Aug 11 2022, 4:17 PM
colewhite claimed this task.
gerritbot added a comment.Aug 11 2022, 4:27 PM

Change 822421 had a related patch set uploaded (by Cwhite; author: Cwhite):

[operations/puppet@production] tcpircbot: add and enable ecs logging handler

https://gerrit.wikimedia.org/r/822421

gerritbot added a project: Patch-For-Review.Aug 11 2022, 4:27 PM

Change 822422 had a related patch set uploaded (by Cwhite; author: Cwhite):

[operations/puppet@production] tcpircbot: send !log events to log stream

https://gerrit.wikimedia.org/r/822422

gerritbot added a comment.Aug 11 2022, 4:33 PM

Change 822423 had a related patch set uploaded (by Cwhite; author: Cwhite):

[operations/puppet@production] tcpircbot: send tcpircbot logs to centralized logging

https://gerrit.wikimedia.org/r/822423

• lmata added a project: SRE Observability (FY2022/2023-Q1).Aug 16 2022, 2:53 PM
• lmata moved this task from Inbox to In progress on the SRE Observability (FY2022/2023-Q1) board.
• lmata moved this task from Backlog to Prioritized on the Observability-Logging board.
gerritbot added a comment.Aug 17 2022, 4:20 PM

Change 822421 merged by Cwhite:

[operations/puppet@production] tcpircbot: add and enable ecs logging handler

https://gerrit.wikimedia.org/r/822421

Stashbot added a comment.Aug 17 2022, 4:24 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-17T16:24:24Z] <cwhite> restart logmsgbot T257861

gerritbot added a comment.Aug 17 2022, 4:53 PM

Change 822423 merged by Cwhite:

[operations/puppet@production] tcpircbot: send tcpircbot logs to centralized logging

https://gerrit.wikimedia.org/r/822423

colewhite mentioned this in T315500: Eliminate field collisions between syslog_cee and ECS-formatted logs.Aug 17 2022, 11:24 PM
gerritbot added a comment.Aug 17 2022, 11:50 PM

Change 824317 had a related patch set uploaded (by Cwhite; author: Cwhite):

[operations/puppet@production] logstash: add tcpircbot logging tests

https://gerrit.wikimedia.org/r/824317

gerritbot added a comment.Aug 23 2022, 5:33 PM

Change 822422 merged by Cwhite:

[operations/puppet@production] tcpircbot: send !log events to log stream

https://gerrit.wikimedia.org/r/822422

Stashbot added a comment.Aug 23 2022, 5:37 PM

Mentioned in SAL (#wikimedia-operations) [2022-08-23T17:37:04Z] <cwhite> restart tcpircbot T257861

gerritbot added a comment.Aug 23 2022, 8:00 PM

Change 825880 had a related patch set uploaded (by Cwhite; author: Cwhite):

[operations/puppet@production] logstash: duplicate sal logs to Loki

https://gerrit.wikimedia.org/r/825880

gerritbot added a comment.Aug 24 2022, 3:20 PM

Change 825880 merged by Cwhite:

[operations/puppet@production] logstash: duplicate sal logs to Loki

https://gerrit.wikimedia.org/r/825880

colewhite closed this task as Resolved.Aug 24 2022, 4:27 PM

SAL is now in Grafana!

• lmata awarded a token.Aug 25 2022, 4:18 PM
fgiunchedi awarded a token.Aug 30 2022, 9:06 AM
gerritbot added a comment.Sep 14 2022, 9:55 PM

Change 824317 merged by Cwhite:

[operations/puppet@production] logstash: add tcpircbot logging tests

https://gerrit.wikimedia.org/r/824317

Maintenance_bot removed a project: Patch-For-Review.Sep 14 2022, 10:31 PM
• lmata moved this task from In progress to Done on the SRE Observability (FY2022/2023-Q1) board.Jul 18 2023, 5:01 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits