Page MenuHomePhabricator

Change logstash plugin deployment to use deb packaging and deployment
Open, MediumPublic

Description

It will be nicer if logstash plugin is deployed via deb deploy using our wikimedia debian repo instead of the current way.
https://wikitech.wikimedia.org/wiki/Debian_Packaging

Details

Related Gerrit Patches:
operations/software/logstash/plugins : masterWIP: move to Debian packaging
operations/puppet : productionlogstash: introduce logstash 7 and openjdk-11 support

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 28 2019, 3:58 PM
jbond added a subscriber: jbond.Mar 4 2019, 7:52 PM

@Mathew.onipe this is probably obvious to most but could you provide information on the "current way"?

jbond triaged this task as Medium priority.Mar 4 2019, 7:52 PM

Picking this up as part of T235891: Ingest production logs with ELK7, and to answer your question @jbond the current way is via scap + puppet

With the upgrade to Elastic 7 as far as I can tell all logstash plugins we're shipping will be included already, in other words we wouldn't need to ship plugins ourselves out of the box. Having said that, the general capability of shipping updates to plugins seems worth having to me.

Change 548880 had a related patch set uploaded (by Herron; owner: Herron):
[operations/puppet@production] logstash: add version param and exclude plugins when non 5.x

https://gerrit.wikimedia.org/r/548880

Change 548880 merged by Herron:
[operations/puppet@production] logstash: introduce logstash 7 and openjdk-11 support

https://gerrit.wikimedia.org/r/548880

Change 552486 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/software/logstash/plugins@master] WIP: move to Debian packaging

https://gerrit.wikimedia.org/r/552486

fgiunchedi moved this task from Inbox to Up next on the observability board.Nov 25 2019, 1:50 PM