Maniphest T108306

better cassandra process checks
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	fgiunchedi
	Aug 7 2015, 10:32 AM

Tags

Referenced Files

None

Subscribers

Description

with additional jvm settings we're pushing out the CassandraDaemon string from cmdline proc file, thus nagios' check_proc is failing. Since cassandra is all systemd anyway we should be using nrpe::monitor_systemd_unit_state instead

See also: T93886: Cassandra/CQL query interface monitoring

Details

	Subject	Repo	Branch	Lines +/-
	cassandra: switch to nrpe::monitor_systemd_unit_state	operations/puppet	production	+2 -5
	cassandra: ship systemd service file	operations/puppet	production	+70 -10

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		fgiunchedi	T108306 better cassandra process checks
		Resolved		fgiunchedi	T95253 Finish conversion to multiple Cassandra instances per hardware node
		Resolved		fgiunchedi	T113733 column family cassandra metrics size
		Resolved		fgiunchedi	T113939 assess impact of many cassandra seed nodes with multi instance
		Resolved		Eevans	T117114 Ensure ansible-deploy can cope with multi-instance restarts
		Resolved		Eevans	T121535 Perform cleanups to reclaim space from recent topology changes
		Resolved		Eevans	T130540 Figure out if nodes in different DCs can be bootstrapped in parallel

Event Timeline

fgiunchedi created this task.Aug 7 2015, 10:32 AM

fgiunchedi claimed this task.

fgiunchedi raised the priority of this task from to Medium.

fgiunchedi updated the task description. (Show Details)

fgiunchedi added a project: acl*sre-team.

fgiunchedi subscribed.

Restricted Application added subscribers: Matanya, Aklapper. · View Herald TranscriptAug 7 2015, 10:32 AM

Change 230066 had a related patch set uploaded (by Filippo Giunchedi):
cassandra: switch to nrpe::monitor_systemd_unit_state

https://gerrit.wikimedia.org/r/230066

gerritbot added a project: Patch-For-Review.Aug 7 2015, 10:33 AM

• mobrovac added a project: RESTBase-Cassandra.Aug 7 2015, 11:13 AM

• mobrovac subscribed.

Wouldn't it be prudent to switch to a real SystemD unit conf file first?

more than prudent, it is a requirement.. for some reason I thought we already did that!

fgiunchedi added a subtask: T95253: Finish conversion to multiple Cassandra instances per hardware node.Aug 18 2015, 9:34 AM

Change 242548 had a related patch set uploaded (by Filippo Giunchedi):
cassandra: ship systemd service file

https://gerrit.wikimedia.org/r/242548

Change 242548 merged by Filippo Giunchedi:
cassandra: ship systemd service file

https://gerrit.wikimedia.org/r/242548

fgiunchedi mentioned this in rOPUP59429606527f: cassandra: ship systemd service file.Oct 1 2015, 9:49 AM

Eevans updated the task description. (Show Details)Oct 9 2015, 3:24 PM

Eevans set Security to None.

resolved by https://gerrit.wikimedia.org/r/#/c/249082/

Change 230066 abandoned by Filippo Giunchedi:
cassandra: switch to nrpe::monitor_systemd_unit_state

Reason:
superceded by https://gerrit.wikimedia.org/r/#/c/249082/

https://gerrit.wikimedia.org/r/230066

fgiunchedi closed subtask T95253: Finish conversion to multiple Cassandra instances per hardware node as Resolved.May 26 2016, 10:53 AM