Page MenuHomePhabricator

VM requests for additional Logstash capacity
Closed, ResolvedPublic

Description

Labs Project Tested: n/a
Site/Location:EQIAD+CODFW
Number of systems: 4 (2 each)
Service: logstash
Networking Requirements: internal
Processor Requirements: 4
Memory: 8GB
Disks: 50GB
Other Requirements: like logstash1023

4 systems total would be ideal, although 2 total (one per site) would work too.

Also the current VM capacity for logstash 5 (the legacy cluster) will be reduced in Q1 from 6 total systems to 2 total.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, Jun 23, 4:00 PM
fgiunchedi moved this task from Backlog to Doing on the User-fgiunchedi board.Tue, Jun 23, 4:05 PM

Change 607634 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] add logstash1030 and logstash1031

https://gerrit.wikimedia.org/r/607634

Change 607637 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] add logstash2030 and logstash2031

https://gerrit.wikimedia.org/r/607637

Change 607634 merged by Dzahn:
[operations/dns@master] add logstash1030 and logstash1031

https://gerrit.wikimedia.org/r/607634

Change 607821 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site: add logstash1030/31 with insetup role

https://gerrit.wikimedia.org/r/607821

Change 607821 merged by Dzahn:
[operations/puppet@production] site: add logstash1030/31 with insetup role

https://gerrit.wikimedia.org/r/607821

Dzahn claimed this task.Thu, Jun 25, 3:49 PM

Change 607637 merged by Dzahn:
[operations/dns@master] add logstash2030 and logstash2031

https://gerrit.wikimedia.org/r/607637

Dzahn added a comment.Thu, Jun 25, 3:57 PM

Creating VM logstash1030.eqiad.wmnet in cluster ganeti01.svc.eqiad.wmnet with row=D vcpus=4 memory=8GB disk=50GB link=private.
Creating VM logstash1031.eqiad.wmnet in cluster ganeti01.svc.eqiad.wmnet with row=D vcpus=4 memory=8GB disk=50GB link=private.
Creating VM logstash2030.codfw.wmnet in cluster ganeti01.svc.codfw.wmnet with row=D vcpus=4 memory=8GB disk=50GB link=private.
Creating VM logstash2031.codfw.wmnet in cluster ganeti01.svc.codfw.wmnet with row=D vcpus=4 memory=8GB disk=50GB link=private.

Creating as requested. Everything will be in the (new) row D in both data centers. In codfw they are the first VMs in this row that can be used now.

Change 607872 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] DHCP: add logstash2030, logstash2031

https://gerrit.wikimedia.org/r/607872

Change 607872 merged by Dzahn:
[operations/puppet@production] DHCP: add logstash2030, logstash2031

https://gerrit.wikimedia.org/r/607872

Change 607875 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] partman: add logstash103[0-1] and logstash2003[0-1]

https://gerrit.wikimedia.org/r/607875

Change 607875 merged by Dzahn:
[operations/puppet@production] partman: add logstash103[0-1] and logstash2003[0-1]

https://gerrit.wikimedia.org/r/607875

Change 607895 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site/DHCP: add logstash[1]203[12]

https://gerrit.wikimedia.org/r/607895

Change 607895 merged by Dzahn:
[operations/puppet@production] site/DHCP: add logstash[12]03[01]

https://gerrit.wikimedia.org/r/607895

@fgiunchedi

4 VMs have been created. OS has been installed.

They have been added to puppet with the "insetup" role.

IPv6 records have also been added.

Here they are in Icinga:

2 VMs in eqiad:

https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=logstash103

2 VMs in codfw:

https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=logstash203

Dzahn closed this task as Resolved.Thu, Jun 25, 11:55 PM