Change Details

== Common information * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: partial-backup.service on gitlab2002:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: partial-backup.service on gitlab2002:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab2002:9100 * **name**: partial-backup.service * **prometheus**: ops * **severity**: critical * **site**: codfw * **source**: prometheus * **team**: collaboration-services == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: partial-backup.service on gitlab2002:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: partial-backup.service on gitlab2002:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab2002:9100 * **name**: partial-backup.service * **prometheus**: ops * **severity**: critical * **site**: codfw * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1)

== Common information * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **alertname**: SystemdUnitFailed * **prometheus**: ops * **severity**: critical * **source**: prometheus * **team**: collaboration-services == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: backup-restore.service on gitlab1003:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: backup-restore.service on gitlab1003:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab1003:9100 * **name**: backup-restore.service * **prometheus**: ops * **severity**: critical * **site**: eqiad * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: backup-restore.service on gitlab1004:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: backup-restore.service on gitlab1004:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab1004:9100 * **name**: backup-restore.service * **prometheus**: ops * **severity**: critical * **site**: eqiad * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: partial-backup.service on gitlab2002:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: partial-backup.service on gitlab2002:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab2002:9100 * **name**: partial-backup.service * **prometheus**: ops * **severity**: critical * **site**: codfw * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1)

== Common information * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: partial-backup.service on gitlab2002:9100runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **alertname**: SystemdUnitFailed * **prometheus**: ops * **severity**: critical * **source**: prometheus * **team**: collaboration-services == Firing alerts --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: backup-restore.service on gitlab1003:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: partial-backup.service on gitlab2002:9100 * **summary**: backup-restore.service on gitlab1003:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab1003:9100 * **name**: backup-restore.service * **prometheus**: ops * **severity**: critical * **site**: eqiad * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: backup-restore.service on gitlab1004:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: backup-restore.service on gitlab1004:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab20021004:9100 * **name**: partial-backupbackup-restore.service * **prometheus**: ops * **severity**: critical * **site**: codfweqiad * **source**: prometheus * **team**: collaboration-services == Firing alerts * [Source](https://prometheus-eqiad.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1) --- * **dashboard**: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status * **description**: partial-backup.service on gitlab2002:9100 * **runbook**: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state * **summary**: partial-backup.service on gitlab2002:9100 * **alertname**: SystemdUnitFailed * **instance**: gitlab2002:9100 * **name**: partial-backup.service * **prometheus**: ops * **severity**: critical * **site**: codfw * **source**: prometheus * **team**: collaboration-services * [Source](https://prometheus-codfw.wikimedia.org/ops/graph?g0.expr=%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%2C+name%29+group_left+%28team%29+systemd_unit_owner%29+%3D%3D+1+or+ignoring+%28team%29+%28instance_name%3Anode_systemd_unit_state_failed%3Acount1+%2A+on+%28instance%29+group_left+%28team%29+role_owner%7Bteam%21%3D%22wmcs%22%7D%29+%3D%3D+1&g0.tab=1)