create blackbox::http monitoring for doc.wikimedia.org
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Dzahn
	Jan 26 2023, 12:15 AM

Description

follow-up task from T327772

create basic blackbox::http check that automatically creates tickets for:

https:://doc.wikimedia.org

only the active server

follow existing examples for phabricator/gitlab/vrts linked in ticket above

Details

	Subject	Repo	Branch	Lines +/-
	doc: fix hostname used in http::blackbox monitoring	operations/puppet	production	+3 -1
	doc: add blackbox::check::http monitor	operations/puppet	production	+10 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Dzahn	T327772 Automatically created ProbeDown tasks for Collab services
Resolved	Dzahn	T329587 http::blackbox monitoring for all https services (let all serviceops-collab alertmanager alerts create tickets)
Resolved	Dzahn	T327973 create blackbox::http monitoring for doc.wikimedia.org
Resolved	Dzahn	T330233 prometheus::blackbox::check::http - allow checking the same virtual host on multiple backends

Event Timeline

Dzahn created this task.Jan 26 2023, 12:15 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 26 2023, 12:15 AM

Change 884393 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] doc: add blackbox::check::http monitor

https://gerrit.wikimedia.org/r/884393

gerritbot added a project: Patch-For-Review.Jan 27 2023, 11:39 PM

LSobanski triaged this task as Medium priority.Jan 30 2023, 4:32 PM

LSobanski moved this task from Incoming to Backlog on the collaboration-services board.

Change 884393 merged by Dzahn:

[operations/puppet@production] doc: add blackbox::check::http monitor

https://gerrit.wikimedia.org/r/884393

Maintenance_bot removed a project: Patch-For-Review.Feb 15 2023, 11:10 PM

Dzahn added a parent task: T329587: http::blackbox monitoring for all https services (let all serviceops-collab alertmanager alerts create tickets).Feb 16 2023, 7:47 PM

Krinkle awarded a token.Feb 18 2023, 1:17 AM

Dzahn mentioned this in T327972: create blackbox::http monitoring for contint (integration.wikimedia.org).Feb 21 2023, 7:50 PM

Change 890903 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] doc: fix hostname used in http::blackbox monitoring

https://gerrit.wikimedia.org/r/890903

gerritbot added a project: Patch-For-Review.Feb 21 2023, 8:26 PM

Dzahn added a subtask: T330233: prometheus::blackbox::check::http - allow checking the same virtual host on multiple backends.Feb 21 2023, 8:45 PM

Change 890903 merged by Dzahn:

[operations/puppet@production] doc: fix hostname used in http::blackbox monitoring

https://gerrit.wikimedia.org/r/890903

Maintenance_bot removed a project: Patch-For-Review.Feb 21 2023, 11:10 PM

Dzahn closed subtask T330233: prometheus::blackbox::check::http - allow checking the same virtual host on multiple backends as Resolved.Feb 22 2023, 12:49 AM

https://thanos.wikimedia.org/graph?g0.expr=probe_success%7Binstance%3D~%22.*doc.*%22%7D&g0.tab=1&g0.stacked=0&g0.range_input=1h&g0.max_source_resolution=0s&g0.deduplicate=0&g0.partial_response=0&g0.store_matches=%5B%5D

Dzahn claimed this task.Feb 22 2023, 1:25 AM

Mentioned in SAL (#wikimedia-operations) [2023-03-02T01:23:38Z] <mutante> doc2001 - stopping apache2 to test alerting - active server is doc1002 but should be switched T327973 T330963

tested and showed up in:

thanos dashboard
alerts.wikimedia.org
created task T330965

Dzahn mentioned this in T330965: ProbeDown.Mar 2 2023, 1:27 AM

create blackbox::http monitoring for doc.wikimedia.orgClosed, ResolvedPublicActions

Description

Details

Related ObjectsSearch...

Event Timeline

create blackbox::http monitoring for doc.wikimedia.org
Closed, ResolvedPublic
Actions

Related Objects
Search...