Improve daily webrequest partition report {hawk} [5 pts]
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• kevinator
	Sep 21 2015, 5:08 PM

Description

Modify the refinery-dump-status-webrequest-partitions shell script to show percent loss instead of X. (script is already run daily via cron).

Difficulty: current script just checks whether success file is present to get actual numbers. You need to make hive report those. How? Execute hive via shell?
see: https://github.com/wikimedia/analytics-refinery/blob/master/bin/refinery-dump-status-webrequest-partitions#L461

	Subject	Repo	Branch	Lines +/-
	Add --percent-lost flag to refinery data check	operations/puppet	production	+2 -2
	Add percent loss to refinery-dump-status script	analytics/refinery	master	+32 -9

		Status	Subtype	Assigned	Task
		Resolved		Ottomata	T109192 Implement better Webrequest load monitoring {hawk}
		Resolved		mforns	T113255 Improve daily webrequest partition report {hawk} [5 pts]

• kevinator raised the priority of this task from to Medium.

• kevinator updated the task description. (Show Details)

mforns set Security to None.

mforns removed mforns as the assignee of this task.Sep 28 2015, 4:54 PM

Change 245921 had a related patch set uploaded (by Mforns):
Add percent loss to refinery-dump-status script

Change 245921 merged by Joal:
Add percent loss to refinery-dump-status script

Just merged the code.
Another change is needed there: https://github.com/wikimedia/operations-puppet/blob/production/manifests/role/analytics/refinery.pp#L209
to add the --percent-lost parameter to the cron that sends email.
Also, should we send that email to more people ?

Change 246412 had a related patch set uploaded (by Mforns):
Add --percent-lost flag to refinery data check

@joal
There it is. I added also all Analytics' engineers to receive tha daily email.

Change 246412 merged by Ottomata:
Add --percent-lost flag to refinery data check

• Nuria closed this task as Resolved.Oct 22 2015, 4:07 PM