Page MenuHomePhabricator
Feed Advanced Search

Today

lmata updated subscribers of T361257: Document Icinga Migration Strategy and Communicate to SRE Teams.

@fgiunchedi should we fold this task into T333638: Desired Icinga state by end of FY2023/2024?

Thu, Jul 4, 9:42 PM · SRE Observability (FY2024/2025-Q1)
lmata moved T361257: Document Icinga Migration Strategy and Communicate to SRE Teams from Inbox to Up next on the SRE Observability (FY2024/2025-Q1) board.
Thu, Jul 4, 9:40 PM · SRE Observability (FY2024/2025-Q1)
lmata moved T359261: Migrate MediaWiki.TwoColConflict.* to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q3) board.
Thu, Jul 4, 9:40 PM · SRE Observability (FY2023/2024-Q3), Observability-Metrics
lmata moved T351179: LVM vg0 close to getting full on prometheus eqiad from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T359168: Knowledge sharing MWP - SRE O11Y mw.track() from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-Platform-Team, Observability-Metrics
lmata moved T359245: Migrate daily.revslider.userprops.disables to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T362376: The prune_old_srv_syslog_directories.service can't delete non-empty directories on centrallog instances from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Logging
lmata moved T359339: Migrate daily.betafeatures.* to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T359349: Migrate daily.catwatch.* to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T359346: Migrate daily.echo.mentionStatus.global_user_counts.totals.* to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T359342: Migrate daily.advancedsearch.userprops.disables to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T246998: Enable SSO for Kibana from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · Patch-For-Review, SRE Observability (FY2023/2024-Q4), Observability-Logging, SRE
lmata moved T359262: Migrate daily.twocolconflict.userprops.* to statslib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · SRE Observability (FY2023/2024-Q4), Observability-Metrics
lmata moved T348508: Curator failed to delete indices in codfw from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:39 PM · Patch-For-Review, SRE Observability (FY2023/2024-Q4), Observability-Logging
lmata moved T360290: Migrate DeferredUpdates to use StatsLib from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MW-1.42-notes (1.42.0-wmf.24; 2024-03-26), MediaWiki-Core-DeferredUpdates, MediaWiki-Platform-Team, Observability-Metrics
lmata moved T302373: Upgrade prometheus-statsd-exporter from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), User-fgiunchedi, Observability-Metrics
lmata moved T356121: PHP Warning: Stats: stop() called before start() from CI from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-libs-Stats
lmata moved T359436: StatsLib equivalent of PerDbNameStatsdDataFactory from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MW-1.43-notes (1.43.0-wmf.1; 2024-04-16), MediaWiki-Platform-Team (Radar), MediaWiki-libs-Stats
lmata moved T364265: How do you cancel a TimingMetric->start() call? from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-libs-Stats
lmata moved T367928: TimingMetric warning on File: page after uploading video file from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MW-1.43-notes (1.43.0-wmf.11; 2024-06-25), Commons, TimedMediaHandler, MediaWiki-libs-Stats, MediaWiki-File-management
lmata moved T361251: titan100[12] ram/ssd upgrade coordination from In progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · DC-Ops, SRE Observability (FY2023/2024-Q4), SRE, observability, ops-eqiad
lmata moved T368073: TimingMetric and recursion edge case from Inbox to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MediaWiki-libs-Stats
lmata moved T361229: titan200[12] RAM/SSD upgrade coordination from In progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · DC-Ops, SRE Observability (FY2023/2024-Q4), SRE, observability, ops-codfw
lmata moved T352517: Put logging-hd[12]00[1-3] in service from In progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), Patch-For-Review, Observability-Logging
lmata moved T337818: apache2 cpu-stuck on logstash hosts causes kafka logging lag from In progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), Observability-Logging
lmata moved T360414: Phase out cergen for Observability services from Epics In Progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · Patch-For-Review, SRE Observability (FY2023/2024-Q4), observability, SRE
lmata moved T240685: MediaWiki Prometheus support from Epics In Progress to Done on the SRE Observability (FY2023/2024-Q4) board.
Thu, Jul 4, 9:38 PM · SRE Observability (FY2023/2024-Q4), MW-1.41-notes (1.41.0-wmf.28; 2023-09-26), MW-1.40-notes (1.40.0-wmf.27; 2023-03-13), MW-1.38-notes (1.38.0-wmf.19; 2022-01-24), MediaWiki-libs-Stats, Platform Team Workboards (External Code Reviews), serviceops, SRE, MediaWiki-General, observability
lmata edited projects for T358037: Migrate wikibase.repo.dispatchChangesJob* to statslib, added: SRE Observability (FY2024/2025-Q1); removed SRE Observability (FY2023/2024-Q4).
Thu, Jul 4, 9:35 PM · SRE Observability (FY2024/2025-Q1), MediaWiki-Platform-Team, Patch-For-Review, Observability-Metrics

Tue, Jul 2

lmata updated the task description for T369122: On-call batphone escalation configuration holidays FY2024/25.
Tue, Jul 2, 9:56 PM · SRE Observability (FY2024/2025-Q1)
lmata created T369122: On-call batphone escalation configuration holidays FY2024/25.
Tue, Jul 2, 9:55 PM · SRE Observability (FY2024/2025-Q1)

Mon, Jul 1

lmata edited projects for T365265: Create a per-release deployment of statsd-exporter for mw-on-k8s, added: SRE Observability (FY2024/2025-Q1); removed SRE Observability (FY2023/2024-Q4).
Mon, Jul 1, 8:35 PM · SRE Observability (FY2024/2025-Q1), Patch-For-Review, MW-on-K8s, serviceops, Observability-Metrics
lmata closed T364006: Splunk On-Call resets overrides after changes to the escalation as Declined.

Turns out, this is expected behavior; if someone has an override for a rotation under an escalation policy, and the rotation is removed from the escalation policy, this resets the overrides for the rotation in question when the rotation is added back, then re-recreated empty. I don't know if there is much to do besides note overrides as the batphone is configured. I'll boldly close this for now, and we can revisit it if this is a persistent problem.

Mon, Jul 1, 8:35 PM · SRE Observability (FY2023/2024-Q4), Observability-Alerting