SystemdUnitFailed - wmf_auto_restart_vrts_rsync.service on vrts1003
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Feb 3 2026, 6:14 PM

Description

Common information

dashboard: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status
description: wmf_auto_restart_vrts_rsync.service on vrts1003:9100
runbook: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
summary: wmf_auto_restart_vrts_rsync.service on vrts1003:9100

alertname: SystemdUnitFailed
instance: vrts1003:9100
name: wmf_auto_restart_vrts_rsync.service
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: collaboration-services

Firing alerts

dashboard: https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status
description: wmf_auto_restart_vrts_rsync.service on vrts1003:9100
runbook: https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
summary: wmf_auto_restart_vrts_rsync.service on vrts1003:9100
alertname: SystemdUnitFailed
instance: vrts1003:9100
name: wmf_auto_restart_vrts_rsync.service
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: collaboration-services
Source

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	VRTS: fix service name for profile::auto_restarts::service for rsync	operations/puppet	production	+1 -1

Customize query in gerrit

Related Objects

Mentioned In: T135991: Automated service restarts for common low-level system services
Mentioned Here: T135991: Automated service restarts for common low-level system services

Event Timeline

phaultfinder created this task.Feb 3 2026, 6:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 3 2026, 6:14 PM

phaultfinder updated the task description. (Show Details)Feb 3 2026, 7:48 PM

comes from this merge today:

https://gerrit.wikimedia.org/r/c/operations/puppet/+/1236308

Change #1236364 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] VRTS: fix service name for profile::auto_restarts::service for rsync

https://gerrit.wikimedia.org/r/1236364

Change #1236364 merged by Dzahn:

[operations/puppet@production] VRTS: fix service name for profile::auto_restarts::service for rsync

https://gerrit.wikimedia.org/r/1236364

Maintenance_bot removed a project: Patch-For-Review.Feb 3 2026, 9:31 PM

Dzahn claimed this task.Feb 3 2026, 11:10 PM

Mentioned in SAL (#wikimedia-operations) [2026-02-03T23:23:29Z] <mutante> vrts1003 - fix systemd state: sed -i 's/vrts_rsync/rsync/' /lib/systemd/system/wmf_auto_restart_vrts_rsync.service ; systemctl daemon-reload - T416380 T135991

Stashbot mentioned this in T135991: Automated service restarts for common low-level system services.Feb 3 2026, 11:23 PM

https://gerrit.wikimedia.org/r/1236364

but after that also:

root@vrts1003:~# sed -i 's/vrts_rsync/rsync/' /lib/systemd/system/wmf_auto_restart_vrts_rsync.service

root@vrts1003:~# systemctl daemon-reload

then:

root@vrts1003:/home/dzahn# systemctl list-units --state=failed
  UNIT LOAD ACTIVE SUB DESCRIPTION
0 loaded units listed.

23:28 < jinxer-wm> RESOLVED: SystemdUnitFailed: wmf_auto_restart_vrts_rsync.service on vrts1003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state -

SystemdUnitFailed - wmf_auto_restart_vrts_rsync.service on vrts1003Closed, ResolvedPublicActions

Description

Common information

Firing alerts

Details

Related Objects

Event Timeline

SystemdUnitFailed - wmf_auto_restart_vrts_rsync.service on vrts1003
Closed, ResolvedPublic
Actions