Maniphest T434970

RdfStreamingUpdaterSpaceUsageTooHigh
Open, HighPublic
Actions

Assigned To

None

Authored By

	phaultfinder
	Sat, Aug 15, 2:55 AM

Project Tags

Referenced Files

None

Subscribers

Description

Common information

dashboard: https://grafana.wikimedia.org/d/fdU5Zx-Mk/wdqs-streaming-updater
description: The containers owned by AUTH_wdqs are using 200.2Gi, this is more than expected.
runbook: https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Clean_up_object_storage
summary: The RDF Streaming Updater is using more than 200GiB of storage

account: AUTH_wdqs
alertname: RdfStreamingUpdaterSpaceUsageTooHigh
cluster: thanos
instance: thanos-fe1004:9112
job: statsd_exporter
prometheus: ops
recorder: thanos-rule@main
severity: task
site: eqiad
source: thanos
team: data-platform

Firing alerts

dashboard: https://grafana.wikimedia.org/d/fdU5Zx-Mk/wdqs-streaming-updater
description: The containers owned by AUTH_wdqs are using 200.2Gi, this is more than expected.
runbook: https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Streaming_Updater#Clean_up_object_storage
summary: The RDF Streaming Updater is using more than 200GiB of storage
account: AUTH_wdqs
alertname: RdfStreamingUpdaterSpaceUsageTooHigh
cluster: thanos
instance: thanos-fe1004:9112
job: statsd_exporter
prometheus: ops
recorder: thanos-rule@main
severity: task
site: eqiad
source: thanos
team: data-platform
Source

Event Timeline

phaultfinder created this task.Sat, Aug 15, 2:55 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSat, Aug 15, 2:55 AM

phaultfinder updated the task description. (Show Details)Sat, Aug 15, 6:55 AM

phaultfinder updated the task description. (Show Details)Sat, Aug 15, 11:00 AM

phaultfinder updated the task description. (Show Details)Sat, Aug 15, 3:00 PM

phaultfinder updated the task description. (Show Details)Sat, Aug 15, 7:05 PM

• Mikeyeak86 added a subtask: T380704: Allow filtering Bitu block log.Sat, Aug 15, 11:05 PM

phaultfinder updated the task description. (Show Details)Sat, Aug 15, 11:05 PM

Reedy removed a subtask: T380704: Allow filtering Bitu block log.Sat, Aug 15, 11:51 PM

phaultfinder updated the task description. (Show Details)Sun, Aug 16, 3:10 AM

phaultfinder updated the task description. (Show Details)Sun, Aug 16, 7:10 AM

phaultfinder updated the task description. (Show Details)Sun, Aug 16, 12:14 PM

Gehel triaged this task as High priority.Mon, Aug 17, 7:01 AM

Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.

Gehel edited projects, added: Data-Platform-SRE (2026-08-07 - 2026-08-28); removed: Data-Platform-SRE.

Gehel moved this task from Backlog - project to Respond to Alerts on the Data-Platform-SRE (2026-08-07 - 2026-08-28) board.

Gehel edited projects, added: Data-Platform-SRE (2026-08-28 - 2026-09-18); removed: Data-Platform-SRE (2026-08-07 - 2026-08-28).Fri, Aug 28, 1:21 PM

Gehel moved this task from Backlog - project to Respond to Alerts on the Data-Platform-SRE (2026-08-28 - 2026-09-18) board.