Implement sensitive logstash access control
Open, MediumPublic
Actions

Assigned To

Authored By

	fgiunchedi
	Jan 16 2019, 11:24 AM

Description

tl;dr pick and implement one of the approaches outlined in T205855: Investigate approaches to ingest sensitive log producers

Details

	Subject	Repo	Branch	Lines +/-
	WIP: add multi-instance support to kibana	operations/puppet	production	+51 -6

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	fgiunchedi	T213157 Increase utilization of application logging pipeline (FY2018-2019 Q3 TEC6)
Resolved	fgiunchedi	T220103 TEC6: Logging infrastructure (Q4 2018/19 goal)
Open	colewhite	T213902 Implement sensitive logstash access control
Open	None	T193766 Ship host syslogs to ELK
Resolved	None	T193664 Knock down puppet 4 deprecation warnings
Open	None	T197173 Ship MX logs to ELK
Open	None	T292682 Develop tooling for quickly parsing 5xx and sampled-1000 logs
Open	None	T288619 Improve the process to consume and use API.LOG to filter out bad performing queries either by extra tooling within o11y or analytics
Open	None	T301110 Ingest webrequest sampled 1000 into logstash
Open	None	T309186 create a sampled log of POST data
Resolved	colewhite	T313868 OpenSearch Security plugin packaging
Resolved	colewhite	T333732 Upgrade OpenSearch using upstream deb packages
Open	None	T350516 Enable OpenSearch security plugin - Beta Logs

Event Timeline

fgiunchedi triaged this task as Medium priority.Jan 16 2019, 11:24 AM

fgiunchedi created this task.

• Phabricator_maintenance moved this task from Backlog to Acknowledged on the SRE board.Jan 26 2019, 11:05 PM

herron moved this task from Backlog to Working on on the User-herron board.May 9 2019, 8:05 PM

herron renamed this task from [stretch] Implement sensitive log access control, onboard 3 sensitive log producers to Implement sensitive log access control.May 21 2019, 8:37 PM

herron renamed this task from Implement sensitive log access control to Implement sensitive logstash access control.

herron mentioned this in T220103: TEC6: Logging infrastructure (Q4 2018/19 goal).

herron added a parent task: T220103: TEC6: Logging infrastructure (Q4 2018/19 goal).

Change 511772 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] WIP: add multi-instance support to kibana

https://gerrit.wikimedia.org/r/511772

gerritbot added a project: Patch-For-Review.May 21 2019, 8:49 PM

fgiunchedi added a project: observability.Aug 19 2019, 2:30 PM

Open Distro for Elasticsearch looks quite promising https://opendistro.github.io/for-elasticsearch/

fgiunchedi moved this task from Inbox to Up next on the observability board.Dec 9 2019, 11:36 AM

fgiunchedi moved this task from Up next to Backlog on the observability board.Jul 2 2020, 2:02 PM

Volans mentioned this in T1: Get puppet runs into logstash.Nov 3 2020, 11:07 AM

Aklapper added a parent task: T1: Get puppet runs into logstash.Nov 3 2020, 12:27 PM