Maniphest T325175

tbs: user-story 11: Add a runbook for each of the service alerts.
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	dcaro
	Dec 14 2022, 3:06 PM

Tags

Referenced Files

None

Subscribers

Description

For each of the alerts created here:

T325160: tbs: user-story 9: I want to know when the service is down

Add a runbook (see https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks) with step-to-step debugging.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Stalled		LucasWerkmeister	T320140 Migrate wd-shex-infer from Toolforge GridEngine to Toolforge Kubernetes
		Stalled		matmarex	T319707 Migrate dtcheck from Toolforge GridEngine to Toolforge Kubernetes
		Open		None	T320062 Migrate steve-adder from Toolforge GridEngine to Toolforge Kubernetes
		Open		None	T320011 Migrate rfa-voting-history from Toolforge GridEngine to Toolforge Kubernetes
		Open		dcaro	T194332 [Epic] Make Toolforge a proper platform as a service with push-to-deploy and build packs
		In Progress		dcaro	T267374 [tbs.beta] Create a toolforge build service beta release
		Open		None	T325172 tbs: user-story 11: I want to know how to debug the service
		Open		None	T325175 tbs: user-story 11: Add a runbook for each of the service alerts.
		Open		None	T325160 tbs: user-story 9: I want to know when the service is down
		Open		None	T325162 tbs: user-story 9: Create an alert on metricsinfra for tekton being down on toolsbeta
		Open		None	T325163 tbs: user-story 9: Create an alert on metricsinfra for tekton being down on tools
		Open		None	T325164 tbs: user-story 9: Create an alert on metricsinfra for harbor being down on tools
		Open		None	T325165 tbs: user-story 9: Create an alert on metricsinfra for harbor being down on toolsbeta
		Resolved		dcaro	T330096 tbs: user-story 9: Gather statistics for harbor uptime in toolsbeta
		Resolved		dcaro	T330757 [tbs.harbor] Harbor core being down is not noticed by simple http request

Event Timeline

dcaro triaged this task as High priority.Dec 14 2022, 3:06 PM

dcaro created this task.

dcaro added a project: Toolforge Build Service.

dcaro added a subtask: T325160: tbs: user-story 9: I want to know when the service is down.Dec 14 2022, 3:07 PM

KHernandez-WMF mentioned this in T325172: tbs: user-story 11: I want to know how to debug the service.Dec 19 2022, 11:52 PM

Raymond_Ndibe added a project: User-Raymond_Ndibe.Jan 17 2023, 10:27 PM

fnegri edited projects, added cloud-services-team; removed cloud-services-team (Kanban).Jan 18 2023, 6:25 PM

fnegri moved this task from Kanban to Inbox on the cloud-services-team board.

dcaro raised the priority of this task from High to Needs Triage.Mon, Mar 6, 3:02 PM