Page MenuHomePhabricator
Create Task
Maniphest T175045

setup/install logstash100[7-9].eqiad.wmnet
Closed, ResolvedPublic
Actions

Description

This task will track the setup and deployment of three new logstash systems via our ganeti infrastructure.

logstash1007:

  • - vm setup per instructions on T173565 (dns was already setup by @akosiaris) vm has been created, just needs start and os install
  • - puppet update for install params
  • - os installation
  • - puppet/salt acceptance
  • - handoff to @Gehel for service implementation

logstash1008:

  • - vm setup per instructions on T173565 (dns was already setup by @akosiaris) vm has been created, just needs start and os install
  • - puppet update for install params
  • - os installation
  • - puppet/salt acceptance
  • - handoff to @Gehel for service implementation

logstash1009:

  • - vm setup per instructions on T173565 (dns was already setup by @akosiaris) vm has been created, just needs start and os install
  • - puppet update for install params
  • - os installation
  • - puppet/salt acceptance
  • - handoff to @Gehel for service implementation

Details

SubjectRepoBranchLines +/-
lgostash - activate icinga alerts on new logstash100[7-9] nodesoperations/puppetproduction+0 -3
logstash - add new logstash hosts to ferm rulesoperations/puppetproduction+6 -0
logstash - ensure plugin directory is presentoperations/puppetproduction+4 -7
logstash - configure new logstash100[7-9] nodesoperations/puppetproduction+11 -2
another install fix for logstashoperations/puppetproduction+1 -1
fixing new logstash entriesoperations/puppetproduction+15 -15
setting logstash100[7-9].eqiad.wmnet install paramsoperations/puppetproduction+21 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

RobH created this task.Sep 5 2017, 5:20 PM
RobH mentioned this in T173565: Provision VMs on Ganeti for logstash100[123].Sep 5 2017, 5:38 PM
RobH updated the task description. (Show Details)
gerritbot added a comment.Sep 5 2017, 5:55 PM

Change 376062 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] setting logstash100[7-9].eqiad.wmnet install params

https://gerrit.wikimedia.org/r/376062

gerritbot added a project: Patch-For-Review.Sep 5 2017, 5:55 PM
gerritbot added a comment.Sep 5 2017, 6:11 PM

Change 376062 merged by RobH:
[operations/puppet@production] setting logstash100[7-9].eqiad.wmnet install params

https://gerrit.wikimedia.org/r/376062

gerritbot added a comment.Sep 5 2017, 6:29 PM

Change 376071 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] fixing new logstash entries

https://gerrit.wikimedia.org/r/376071

gerritbot added a comment.Sep 5 2017, 6:30 PM

Change 376071 merged by RobH:
[operations/puppet@production] fixing new logstash entries

https://gerrit.wikimedia.org/r/376071

gerritbot added a comment.Sep 5 2017, 6:53 PM

Change 376073 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] another install fix for logstash

https://gerrit.wikimedia.org/r/376073

gerritbot added a comment.Sep 5 2017, 6:54 PM

Change 376073 merged by RobH:
[operations/puppet@production] another install fix for logstash

https://gerrit.wikimedia.org/r/376073

RobH updated the task description. (Show Details)Sep 5 2017, 8:00 PM
RobH updated the task description. (Show Details)Sep 5 2017, 9:48 PM
RobH updated the task description. (Show Details)Sep 5 2017, 9:53 PM
RobH updated the task description. (Show Details)Sep 5 2017, 10:08 PM
RobH reassigned this task from RobH to Gehel.Sep 5 2017, 10:31 PM
RobH removed a project: Patch-For-Review.
RobH updated the task description. (Show Details)

Ok, handing this to @Gehel for followup. Feel free to use or resolve task as needed.

Gehel added a comment.Sep 7 2017, 9:14 AM

I'm taking over this task for service implementation.

Gehel created subtask T175242: all log producers need to use the logstash LVS endpoint.Sep 7 2017, 9:16 AM
gerritbot added a comment.Sep 7 2017, 9:26 AM

Change 376488 had a related patch set uploaded (by Gehel; owner: Guillaume Lederrey):
[operations/puppet@production] logstash - configure new logstash100[7-9] nodes

https://gerrit.wikimedia.org/r/376488

gerritbot added a project: Patch-For-Review.Sep 7 2017, 9:26 AM
debt moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.Sep 7 2017, 5:40 PM
Stashbot subscribed.Sep 13 2017, 1:23 PM

Mentioned in SAL (#wikimedia-operations) [2017-09-13T13:23:07Z] <gehel> initial installation of logstash100[7-9] - T175045

gerritbot added a comment.Sep 13 2017, 1:23 PM

Change 376488 merged by Gehel:
[operations/puppet@production] logstash - configure new logstash100[7-9] nodes

https://gerrit.wikimedia.org/r/376488

gerritbot added a comment.Sep 13 2017, 1:35 PM

Change 377755 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] logstash - ensure plugin directory is present

https://gerrit.wikimedia.org/r/377755

gerritbot added a comment.Sep 13 2017, 1:37 PM

Change 377755 merged by Gehel:
[operations/puppet@production] logstash - ensure plugin directory is present

https://gerrit.wikimedia.org/r/377755

gerritbot added a comment.Sep 13 2017, 2:01 PM

Change 377763 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] logstash - add new logstash hosts to ferm rules

https://gerrit.wikimedia.org/r/377763

gerritbot added a comment.Sep 13 2017, 2:06 PM

Change 377763 merged by Gehel:
[operations/puppet@production] logstash - add new logstash hosts to ferm rules

https://gerrit.wikimedia.org/r/377763

gerritbot added a comment.Sep 13 2017, 2:20 PM

Change 377771 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] lgostash - activate icinga alerts on new logstash100[7-9] nodes

https://gerrit.wikimedia.org/r/377771

gerritbot added a comment.Sep 13 2017, 2:22 PM

Change 377771 merged by Gehel:
[operations/puppet@production] lgostash - activate icinga alerts on new logstash100[7-9] nodes

https://gerrit.wikimedia.org/r/377771

Stashbot added a comment.Sep 13 2017, 2:31 PM

Mentioned in SAL (#wikimedia-operations) [2017-09-13T14:31:10Z] <gehel> pooling new logstash servers (logstash100[7-9]) - T175045

Gehel moved this task from not in use - please delete to Needs Reporting on the Discovery-Search (Current work) board.Sep 13 2017, 2:52 PM

The new logstash servers are up, running and pooled. We still need to switch all log producers to them and decom them, but there are other tasks for that. This can be closed.

debt closed this task as Resolved.Sep 15 2017, 8:14 PM
debt subscribed.

Thanks, @RobH and @Gehel !

debt closed subtask T175242: all log producers need to use the logstash LVS endpoint as Resolved.Dec 8 2017, 8:45 PM
fgiunchedi added a project: observability.Aug 19 2019, 2:31 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL