follow-up task from T327772
create basic blackbox::http check that automatically creates tickets for:
contint (https://integration.wikimedia.org)
check the integration.wikimedia.org vhost on both backends
follow existing examples for phabricator/gitlab/vrts linked in ticket above
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Dzahn | T327772 Automatically created ProbeDown tasks for Collab services | |||
| Resolved | Dzahn | T329587 http::blackbox monitoring for all https services (let all serviceops-collab alertmanager alerts create tickets) | |||
| Resolved | Dzahn | T327972 create blackbox::http monitoring for contint (integration.wikimedia.org) |
Change 884395 had a related patch set uploaded (by Dzahn; author: Dzahn):
[operations/puppet@production] integration: add blackbox::check::http monitor
Change 884395 merged by Dzahn:
[operations/puppet@production] integration: add blackbox::check::http monitor
This alert is currently firing, see https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=h@28cc80f&_a=h@5bbe4f8
The link is missing some filters. This link should filter on integration probes: https://logstash.wikimedia.org/goto/2cc06d681937bb73fee7eea0e0e49b27
when trying to open those URLs I just see "Unable to completely restore the URL, be sure to use the share functionality." fwiw.
But this did make me find this other issue, with the checks for doc.wikimedia.org:
x509: certificate is valid for doc.discovery.wmnet, doc.wikimedia.org, doc1001.eqiad.wmnet, doc2001.codfw.wmnet, not doc.wikimedia.org-doc2001.codfw.wmnet
did you maybe mean T327973 or really integration.wikimedia.org ?
Change 890919 had a related patch set uploaded (by Dzahn; author: Dzahn):
[operations/puppet@production] ci::firewall: allow monitoring hosts to check httpd on contint*
Change 890919 merged by Dzahn:
[operations/puppet@production] ci::firewall: allow monitoring hosts to check http on contint*
Change 890920 had a related patch set uploaded (by Dzahn; author: Dzahn):
[operations/puppet@production] ci::firewall: allow http monitoring from prometheus hosts
Change 890920 merged by Dzahn:
[operations/puppet@production] ci::firewall: allow http monitoring from prometheus hosts
Change 890921 had a related patch set uploaded (by Dzahn; author: Dzahn):
[operations/puppet@production] ci: set port 1443 for https monitoring
Change 890921 merged by Dzahn:
[operations/puppet@production] ci: set port 1443 for https monitoring
probe_success{address="208.80.153.15", family="ip4", instance="contint2001:1443", job="probes/custom", module="http_integration_wikimedia_org_ip4", prometheus="ops", site="codfw"}
1
probe_success{address="208.80.154.132", family="ip4", instance="contint1002:1443", job="probes/custom", module="http_integration_wikimedia_org_ip4", prometheus="ops", site="eqiad"}
1