Change Details

== Common information * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1)

== Common information * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **alertname**: ProbeDown * **family**: ip4 * **job**: probes/custom * **prometheus**: ops * **severity**: task * **source**: prometheus * **team**: search-platform == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_full_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_full_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_full_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_full_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_main_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_main_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_main_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_main_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1)

== Common information * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_full_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_full_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_main_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_main_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_collab_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_collab_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb2003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_ip4 from codfw. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb2003:443 * **summary**: Service miscweb2003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_ip4) * **address**: 10.192.48.65 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb2003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: codfw * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_full_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_full_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_full_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_full_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_full_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_full_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_full_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_main_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_main_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_main_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_main_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_main_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_main_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_main_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_collab_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_collab_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_collab_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_collab_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All * **description**: miscweb1003:443 failed when probed by http_query_scholarly_experimental_wikidata_org_ip4 from eqiad. Availability is 0%. * **logs**: https://logstash.wikimedia.org/app/dashboards#/view/f3e709c0-a5f8-11ec-bf8e-43f1807d5bc2?_g=(filters:!((query:(match_phrase:(service.name:http_query_scholarly_experimental_wikidata_org_ip4))))) * **runbook**: https://wikitech.wikimedia.org/wiki/Runbook#miscweb1003:443 * **summary**: Service miscweb1003:443 has failed probes (http_query_scholarly_experimental_wikidata_org_ip4) * **address**: 10.64.48.113 * **alertname**: ProbeDown * **family**: ip4 * **instance**: miscweb1003:443 * **job**: probes/custom * **module**: http_query_scholarly_experimental_wikidata_org_ip4 * **prometheus**: ops * **severity**: task * **site**: eqiad * **source**: prometheus * **team**: search-platform * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=avg_over_time%28probe_success%7Bmodule%3D~%22http_query_scholarly_experimental_wikidata_org_.%2A%22%7D%5B1m%5D%29+%2A+100+%3C+75&g0.tab=1)