decom neon (shutdown neon (icinga) after it has been replaced )
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Dzahn
	Jan 28 2016, 12:46 AM

Description

neon (icinga) is on precise, but should be jessie

Details

Subject	Repo	Branch	Lines +/-
icinga: remove pre-jessie conditional from monitoring::group	operations/puppet	production	+17 -33
remove neon.wikimedia.org, keep neon.mgmt	operations/dns	master	+1 -5
remove neon from puppet/netboot/dhcp/network	operations/puppet	production	+1 -44
icinga: remove ServerAlias with hardcoded hostname	operations/puppet	production	+0 -2
icinga: put role on einsteinium for testing	operations/puppet	production	+1 -0
add tegmen and einsteinium to site.pp	operations/puppet	production	+12 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Dzahn	T123525 reduce amount of remaining Ubuntu 12.04 (precise) systems in production
Resolved	Dzahn	T125023 decom neon (shutdown neon (icinga) after it has been replaced )
Resolved	akosiaris	T121583 setup/deploy tegmen/WMF6381 as monitoring host
Resolved	Papaul	T122065 tegmen/wmf6381: apply hostname label & update visible label field in racktables
Resolved	akosiaris	T121582 setup/deploy einsteinium as monitoring host
Resolved	• Cmjohnson	T150490 decom neon (data center)

Event Timeline

Dzahn created this task.Jan 28 2016, 12:46 AM

Dzahn renamed this task from upgrade neon (icinga) to upgrade neon (icinga) to jessie.

Dzahn raised the priority of this task from to Needs Triage.

Dzahn updated the task description. (Show Details)

Dzahn added projects: SRE, Icinga.

Dzahn set Security to None.

Dzahn added subscribers: Krenair, Ricordisamoa, hashar and 4 others.

hashar unsubscribed.Feb 1 2016, 1:21 PM

@akosiaris would it be helpful if i'd request a separate misc. machine and put the neon roles on a jessie machine, (while not touching neon), then see if we can replace it?

@Dzahn. We 've already got replacement boxes.

See T121583 and T121582 respectively for codfw and eqiad. But don't just reuse einsteinium to replace neon, the idea is to manage to kill neon this quarter.

Dzahn changed the task status from Open to Stalled.Apr 12 2016, 2:13 PM

Dzahn added subtasks: T121583: setup/deploy tegmen/WMF6381 as monitoring host, T121582: setup/deploy einsteinium as monitoring host .

Andrew assigned this task to Dzahn.Apr 14 2016, 9:01 PM

Andrew triaged this task as Medium priority.

Change 284264 had a related patch set uploaded (by Dzahn):
add tegmen and einsteinium to site.pp

https://gerrit.wikimedia.org/r/284264

Restricted Application added a subscriber: TerraCodes. · View Herald TranscriptApr 19 2016, 7:07 PM

gerritbot added a project: Patch-For-Review.Apr 19 2016, 7:07 PM

Change 284264 merged by Dzahn:
add tegmen and einsteinium to site.pp

https://gerrit.wikimedia.org/r/284264

In T125023#2198454, @akosiaris wrote:

@Dzahn. We 've already got replacement boxes.
But don't just reuse einsteinium to replace neon, the idea is to manage to kill neon this quarter.

What does the "kill but don't just replace" mean? We still want icinga on it, right?

Change 284277 had a related patch set uploaded (by Dzahn):
icinga: put role on einsteinium for testing

https://gerrit.wikimedia.org/r/284277

In T125023#2219847, @Dzahn wrote:

In T125023#2198454, @akosiaris wrote:

@Dzahn. We 've already got replacement boxes.
But don't just reuse einsteinium to replace neon, the idea is to manage to kill neon this quarter.

What does the "kill but don't just replace" mean? We still want icinga on it, right?

My fault:

s/neon/icinga/, s/kill/replace/

So the idea is to get rid of icinga (and neon). So no, we don't want icinga on einsteinium.

Change 284277 abandoned by Dzahn:
icinga: put role on einsteinium for testing

https://gerrit.wikimedia.org/r/284277

Oh, ok. but we know what will replace Icinga?

technically this bug is invalid. we will not do this. we will just setup einsteinium and tegmen with shinken and one day shut this down

Dzahn renamed this task from upgrade neon (icinga) to jessie to shutdown neon (icinga) after it has been replaced with shinken.Apr 25 2016, 11:33 PM

Dzahn edited projects, added Shinken; removed Patch-For-Review.

Do we have/need a separate ticket for migrating from icinga to shinken?

Dzahn mentioned this in T118181: Planning for phasing out non-Forward-Secret TLS ciphers.Jul 20 2016, 3:10 PM

neon has been replaced with einsteinium and tegmen, which runs a newer icinga on jessie. renaming this ticket again and using it as a decom ticket. the initial purpose was to shutdown a precise instance.

Dzahn renamed this task from shutdown neon (icinga) after it has been replaced with shinken to decom neon (shutdown neon (icinga) after it has been replaced ).Oct 27 2016, 9:59 PM

Dzahn claimed this task.

Change 318437 had a related patch set uploaded (by Dzahn):
remove neon from puppet/netboot/dhcp

https://gerrit.wikimedia.org/r/318437

gerritbot added a project: Patch-For-Review.Oct 27 2016, 10:00 PM

Change 318439 had a related patch set uploaded (by Dzahn):
icinga: remove ServerAlias with hardcoded hostname

https://gerrit.wikimedia.org/r/318439

Change 318442 had a related patch set uploaded (by Dzahn):
icinga: remove pre-jessie conditional from monitoring::group

https://gerrit.wikimedia.org/r/318442

Change 318444 had a related patch set uploaded (by Dzahn):
remove neon.wikimedia.org, keep neon.mgmt

https://gerrit.wikimedia.org/r/318444

Change 318439 merged by Alexandros Kosiaris:
icinga: remove ServerAlias with hardcoded hostname

https://gerrit.wikimedia.org/r/318439

akosiaris closed subtask T121582: setup/deploy einsteinium as monitoring host as Resolved.Oct 31 2016, 10:05 AM

Change 318437 merged by Dzahn:
remove neon from puppet/netboot/dhcp/network

https://gerrit.wikimedia.org/r/318437

Mentioned in SAL (#wikimedia-operations) [2016-11-10T20:33:55Z] <mutante> neon - deactivated puppet node, scheduled icinga downtime, shutdown server permanently (T125023)