Page MenuHomePhabricator

lmata (Leo Mata)
SRE

Projects (8)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
May 14 2020, 7:26 PM (88 w, 4 d)
Availability
Available
IRC Nick
lmata
LDAP User
LMata
MediaWiki User
LMata (WMF) [ Global Accounts ]

Recent Activity

Today

herron awarded T292254: incidents occurring during Q2 have been scored with the scorecard a Like token.
Tue, Jan 25, 4:30 PM · SRE-OnFire (FY2021/2022-Q3)
lmata added a comment to T292254: incidents occurring during Q2 have been scored with the scorecard.

@herron @jcrespo +1 to untagging stalled tasks and sunsetting the old docs tag; I think we can revisit having a different tag for docs once the process is more mature. For now, less is probably more; I will proceed to do some cleanup. Thanks for surfacing this!

Tue, Jan 25, 4:02 PM · SRE-OnFire (FY2021/2022-Q3)

Yesterday

lmata updated the task description for T292254: incidents occurring during Q2 have been scored with the scorecard.
Mon, Jan 24, 9:38 PM · SRE-OnFire (FY2021/2022-Q3)
lmata updated the task description for T292254: incidents occurring during Q2 have been scored with the scorecard.
Mon, Jan 24, 9:36 PM · SRE-OnFire (FY2021/2022-Q3)
lmata created T299977: incidents occurring in Q3 have been scored with the scorecard.
Mon, Jan 24, 9:33 PM · SRE-OnFire (FY2021/2022-Q3)
lmata renamed T292254: incidents occurring during Q2 have been scored with the scorecard from incidents occurring during Q2 and Q3 have been scored with the scorecard to incidents occurring during Q2 have been scored with the scorecard.
Mon, Jan 24, 9:33 PM · SRE-OnFire (FY2021/2022-Q3)
lmata moved T202061: Implement an accurate and easy to understand status page for all wikis from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE-OnFire board.
Mon, Jan 24, 9:32 PM · SRE-OnFire (FY2021/2022-Q3), Infrastructure-Foundations, SRE Observability (FY2021/2022-Q3), SRE
lmata removed a project from T292254: incidents occurring during Q2 have been scored with the scorecard: SRE Observability (FY2021/2022-Q3).
Mon, Jan 24, 9:32 PM · SRE-OnFire (FY2021/2022-Q3)
Ladsgroup awarded T299147: Retire WatchMouse (CA DX APP) a Like token.
Mon, Jan 24, 6:16 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3)
lmata added a comment to T299147: Retire WatchMouse (CA DX APP).

After an internal discussion with the team, we are aiming for a target retirement at the end of Jan 2022.

Mon, Jan 24, 3:44 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3)

Fri, Jan 21

lmata moved T299700: Remove legacy ELK LVS entries from Inbox to Done on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:29 PM · Traffic, Patch-For-Review, SRE Observability (FY2021/2022-Q3), SRE
lmata moved T97099: Squeeze value out of external monitoring services from Up next to Done on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:29 PM · SRE Observability (FY2021/2022-Q3), Performance Issue
lmata moved T297604: cergen should include the cert's name in SAN too from Inbox to Done on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:29 PM · SRE Observability (FY2021/2022-Q3), User-fgiunchedi
lmata moved T299383: Move graphite back to eqiad from Inbox to Done on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:28 PM · SRE Observability (FY2021/2022-Q3)
lmata closed T97099: Squeeze value out of external monitoring services as Declined.
Fri, Jan 21, 8:13 PM · SRE Observability (FY2021/2022-Q3), Performance Issue
lmata moved T97099: Squeeze value out of external monitoring services from Inbox to Up next on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:09 PM · SRE Observability (FY2021/2022-Q3), Performance Issue
lmata moved T285769: Ensure SRE team has a good understanding of how & when to declare an outage on the status page; & it is easy to do so from Inbox to In progress on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:09 PM · SRE Observability (FY2021/2022-Q3), SRE-OnFire (FY2021/2022-Q3), SRE
lmata moved T292603: DX App Synthetic Monitoring App - watchmouse alert flapping due to CA expiration from Inbox to Up next on the SRE Observability (FY2021/2022-Q3) board.
Fri, Jan 21, 8:09 PM · SRE Observability (FY2021/2022-Q3), Patch-For-Review, SRE
RLazarus awarded T299761: error deleting user from splunk on call a Like token.
Fri, Jan 21, 5:09 PM · SRE Observability (FY2021/2022-Q3)
lmata closed T299761: error deleting user from splunk on call as Resolved.
Fri, Jan 21, 12:41 PM · SRE Observability (FY2021/2022-Q3)
lmata changed the status of T299761: error deleting user from splunk on call from Open to In Progress.
Fri, Jan 21, 12:40 PM · SRE Observability (FY2021/2022-Q3)
lmata added a comment to T299761: error deleting user from splunk on call.

from support"

Fri, Jan 21, 12:39 PM · SRE Observability (FY2021/2022-Q3)
lmata created T299761: error deleting user from splunk on call.
Fri, Jan 21, 12:38 PM · SRE Observability (FY2021/2022-Q3)

Thu, Jan 20

lmata awarded T240685: MediaWiki Prometheus support a Love token.
Thu, Jan 20, 7:06 PM · MW-1.38-notes (1.38.0-wmf.19; 2022-01-24), MediaWiki-libs-Metrics, Platform Team Workboards (External Code Reviews), Patch-For-Review, serviceops, SRE, MediaWiki-General, observability

Tue, Jan 18

lmata edited projects for T214819: Add license statement to Grafana dashboards, added: Observability-Metrics; removed SRE Observability.
Tue, Jan 18, 5:47 PM · Observability-Metrics, observability, Graphite, WMF-Legal, Software-Licensing, SRE
lmata edited projects for T225721: PHP statsd client doesn't support tagging metrics, added: Observability-Metrics; removed SRE Observability.
Tue, Jan 18, 5:47 PM · Observability-Metrics, observability, SRE, Graphite
lmata added a project to T262741: "Wikidata API format usage" Grafana dashboard is empty: Observability-Metrics.
Tue, Jan 18, 5:47 PM · Observability-Metrics, observability, Wikidata, Graphite
lmata added a project to T296295: Revise and improve Graphite backfill procedure: Observability-Metrics.
Tue, Jan 18, 5:46 PM · Observability-Metrics, Graphite
lmata added a comment to T216090: ensure httpd error logs from "misc apps" (krypton) end up in logstash.

Thank you for the update this will help for backlog priorities setting.

Tue, Jan 18, 12:12 AM · Observability-Logging, observability, Wikimedia-Logstash, SRE, serviceops

Mon, Jan 17

lmata edited projects for T233735: Emergency response to logstash being backlogged, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:29 PM · Observability-Logging, observability, Sustainability (Incident Followup), Wikimedia-Logstash
lmata edited projects for T233739: MediaWiki log spam during row D blip / rack D2 unavailable, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:29 PM · Observability-Logging, observability, Sustainability (Incident Followup), MediaWiki-General, Wikimedia-Logstash
lmata added a project to T234565: Standardize the logging format: Observability-Logging.
Mon, Jan 17, 11:28 PM · Observability-Logging, SRE Observability (FY2021/2022-Q3), observability, Patch-For-Review, Wikimedia-Logstash, SRE
lmata edited projects for T235891: Ingest production logs with ELK7, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:28 PM · Observability-Logging, observability, SRE, Wikimedia-Logstash
lmata edited projects for T237224: Backup kibana indices, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:28 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata edited projects for T261225: Set strict CSP rule on Kibana logstash.wikimedia.org, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:27 PM · Observability-Logging, observability, Security, Wikimedia-Logstash
lmata added a project to T223924: pybal logs into logstash: Observability-Logging.
Mon, Jan 17, 11:27 PM · Observability-Logging, observability, SRE, Wikimedia-Logstash
lmata added a project to T222365: Periodic logging failure reported by swift: Observability-Logging.
Mon, Jan 17, 11:27 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata edited projects for T215900: Introduce logging pipeline input ratelimit, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:27 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata added a project to T214031: Investigate missing WikibaseQualityConstraints logs in logstash.: Observability-Logging.
Mon, Jan 17, 11:27 PM · Observability-Logging, observability, User-Addshore, SRE, Wikimedia-Logstash
lmata edited projects for T213902: Implement sensitive logstash access control, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:26 PM · Observability-Logging, observability, Patch-For-Review, User-herron, SRE, Wikimedia-Logstash
lmata edited projects for T237630: Production logstash should be protected by two-factor auth, at the least, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:26 PM · Observability-Logging, observability, Privacy Engineering, SRE, Privacy, Wikimedia-Logstash
lmata edited projects for T233904: [api-feature] Cyberbot_I uses deprecated API entry points, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:26 PM · Observability-Logging, observability, Wikimedia-Logstash, Cyberbot
lmata edited projects for T247675: Stop overriding LogstashFormatter format, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:26 PM · Observability-Logging, observability, Patch-For-Review, Platform Team Workboards (Clinic Duty Team), Technical-Debt, Wikimedia-Logstash, MediaWiki-Debug-Logger
lmata edited projects for T248400: elk7: fields indexed without position data; cannot run PhraseQuery, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:26 PM · Observability-Logging, observability, Patch-For-Review, SRE, Wikimedia-Logstash
lmata added a project to T248884: Documentation of client side error logging capabilities on mediawiki: Observability-Logging.
Mon, Jan 17, 11:25 PM · Observability-Logging, observability, Instrument-ClientError, Analytics-Radar, Documentation, Performance-Team (Radar), Wikimedia-Logstash, Better Use Of Data
lmata edited projects for T255508: The UI timestamp in Kibana should be based on source not Logstash intake (for PHP-FPM and MW), added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:25 PM · Observability-Logging, observability, Wikimedia-Logstash, Developer Productivity
lmata edited projects for T215497: Move iegreview from udp2log to syslog, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:25 PM · Observability-Logging, observability, Patch-For-Review, Wikimedia-Logstash, SRE
lmata added a project to T216090: ensure httpd error logs from "misc apps" (krypton) end up in logstash: Observability-Logging.
Mon, Jan 17, 11:25 PM · Observability-Logging, observability, Wikimedia-Logstash, SRE, serviceops
lmata edited projects for T207296: Rationalize default logrotate "rotated" file extensions, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:24 PM · Observability-Logging, observability, Wikimedia-Logstash, SRE
lmata edited projects for T197173: Ship MX logs to ELK, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:24 PM · Observability-Logging, observability, User-herron, Wikimedia-Logstash, SRE
lmata edited projects for T180051: Reduce the number of fields declared in elasticsearch by logstash, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:24 PM · Observability-Logging, observability, Patch-For-Review, Platform Team Legacy (Watching / External), Services (watching), SRE, Wikimedia-Logstash
lmata added a project to T176065: Include Varnish XID in Logstash: Observability-Logging.
Mon, Jan 17, 11:24 PM · Observability-Logging, observability, MediaWiki-Debug-Logger, Wikimedia-Logstash
lmata edited projects for T166107: Cleanup old logstash logs (application and JVM GC), added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:23 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata added a project to T126292: Evaluate log volume and impact of sending full logstream of testwiki, test2wiki and mw1017 into Logstash: Observability-Logging.
Mon, Jan 17, 11:23 PM · Observability-Logging, observability, Wikimedia-Logstash, MediaWiki-Debug-Logger
lmata added a project to T141500: Setup ELK based logging for tool labs infrastructure components: Observability-Logging.
Mon, Jan 17, 11:23 PM · Observability-Logging, observability, Wikimedia-Logstash, Toolforge
lmata added a project to T140282: Create a grafana dashboard for logstash*.eqiad.wmnet based on search dashboards: Observability-Logging.
Mon, Jan 17, 11:22 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata added a project to T70820: Automatically log fatals/exceptions into Phabricator with stack traces: Observability-Logging.
Mon, Jan 17, 11:22 PM · Observability-Logging, observability, Wikimedia-Logstash
lmata edited projects for T257024: Buster elasticsearch-curator version not compatible with ELK7, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:19 PM · Observability-Logging, observability, SRE, Wikimedia-Logstash
lmata edited projects for T272238: Elasticsearch and Kibana are switching to non-OSI-approved SSPL licence, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:18 PM · Observability-Logging, observability, Software-Licensing, Wikimedia-Logstash, SRE
lmata added a project to T279112: meta.domain in Logstash seems to usually not like doing term matches: Observability-Logging.
Mon, Jan 17, 11:18 PM · Observability-Logging, Instrument-ClientError, observability, Wikimedia-Logstash
lmata edited projects for T283753: Stack traces in logstash should follow ecs schema for field naming, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:18 PM · Observability-Logging, observability, Wikimedia-Logstash, Phatality
lmata edited projects for T291645: Integrate Event Platform and ECS logs, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:12 PM · Observability-Logging, Analytics, Data-Engineering, Event-Platform, Wikimedia-Logstash, SRE
lmata edited projects for T205856: Retire udp2log: onboard its producers and consumers to the logging pipeline, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:12 PM · Observability-Logging, observability, Analytics-Radar, Performance-Team (Radar), Wikimedia-Logstash, SRE
lmata edited projects for T176335: logs sent to logstash are lost when the elasticsearch cirrus cluster is unavailable, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:12 PM · Observability-Logging, Sustainability (Incident Followup), observability, SRE, Elasticsearch, Wikimedia-Logstash
lmata edited projects for T126989: MediaWiki logging & encryption, added: Observability-Logging; removed SRE Observability.
Mon, Jan 17, 11:11 PM · Observability-Logging, observability, MW-1.33-notes (1.33.0-wmf.24; 2019-04-02), Patch-For-Review, Wikimedia-Logstash, MediaWiki-Debug-Logger, SRE
lmata edited projects for T288196: Retire Prometheus 'global' instance, added: Observability-Metrics; removed SRE Observability.
Mon, Jan 17, 11:10 PM · Observability-Metrics, Performance-Team (Radar)
lmata edited projects for T267019: Alert design guidelines for teams are produced, added: Observability-Alerting; removed SRE Observability.
Mon, Jan 17, 11:10 PM · Observability-Alerting
lmata edited projects for T85624: Better abstractions for puppet & icinga/nagios/shinken, added: Observability-Alerting; removed SRE Observability.
Mon, Jan 17, 11:10 PM · Observability-Alerting, SRE
lmata edited projects for T278514: Wishlist for AlertManager alerts from Grafana, added: Observability-Alerting; removed SRE Observability.
Mon, Jan 17, 11:09 PM · Observability-Alerting, User-fgiunchedi, Performance-Team (Radar)
lmata edited projects for T297231: Sending Apache Spark metrics to PushGateway, added: Observability-Metrics; removed SRE Observability.
Mon, Jan 17, 11:09 PM · Observability-Metrics
lmata edited projects for T293970: Alert on systemd units crashloops, added: Observability-Alerting; removed SRE Observability.
Mon, Jan 17, 11:08 PM · Observability-Alerting
lmata edited projects for T294564: Migrate Foundations Prometheus alerts to AlertManager, added: Observability-Alerting; removed SRE Observability.
Mon, Jan 17, 11:07 PM · Observability-Alerting
lmata moved T288851: Make logging work for mediawiki in k8s from Backlog to Radar on the SRE Observability board.
Mon, Jan 17, 4:20 PM · Patch-For-Review, SRE Observability, MW-on-K8s, serviceops, SRE
lmata edited projects for T272238: Elasticsearch and Kibana are switching to non-OSI-approved SSPL licence, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:13 PM · Observability-Logging, observability, Software-Licensing, Wikimedia-Logstash, SRE
lmata edited projects for T286768: node_cpu_frequency_hertz metric no longer present in Bullseye, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM · SRE Observability, SRE
lmata archived SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM
lmata edited projects for T291148: VarnishTrafficDrop alert false positives due to DCs depooled, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM · SRE Observability, SRE, Traffic
lmata edited projects for T290009: Add Budget Burndown Panels to SLO Dashboard Template, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM · SRE Observability, Patch-For-Review
lmata edited projects for T291645: Integrate Event Platform and ECS logs, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2), Observability-Logging.
Mon, Jan 17, 4:12 PM · Observability-Logging, Analytics, Data-Engineering, Event-Platform, Wikimedia-Logstash, SRE
lmata edited projects for T292606: Grafana share button drops duplicate URL params, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM · SRE Observability, SRE
lmata edited projects for T293399: Migrate analytics cluster alerts from Icinga to AlertManager, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:12 PM · SRE Observability, Data-Engineering-Kanban, Patch-For-Review, Analytics-Kanban, Data-Engineering, User-fgiunchedi
lmata edited projects for T290012: Add service SLO URL to template, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:11 PM · SRE Observability
lmata edited projects for T290870: rsyslog service should fail on configuration errors , added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:11 PM · SRE Observability, User-ema, User-fgiunchedi, SRE
lmata edited projects for T293198: Strip port from "instance" label on outgoing alertmanager alerts, added: SRE Observability; removed SRE Observability (FY2021/2022-Q2).
Mon, Jan 17, 4:11 PM · SRE Observability, User-fgiunchedi
MoritzMuehlenhoff awarded T299147: Retire WatchMouse (CA DX APP) a 100 token.
Mon, Jan 17, 3:27 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3)

Thu, Jan 13

lmata moved T299137: Improve ORES observability from Inbox to Radar on the observability board.
Thu, Jan 13, 8:06 PM · observability, Machine-Learning-Team
herron awarded T299147: Retire WatchMouse (CA DX APP) a Cup of Joe token.
Thu, Jan 13, 5:21 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3)
lmata created T299147: Retire WatchMouse (CA DX APP).
Thu, Jan 13, 5:11 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3)
lmata added a project to T202061: Implement an accurate and easy to understand status page for all wikis: Infrastructure-Foundations.
Thu, Jan 13, 4:57 PM · SRE-OnFire (FY2021/2022-Q3), Infrastructure-Foundations, SRE Observability (FY2021/2022-Q3), SRE
lmata edited projects for T298610: Upgrade Karma (alerts dashboard), added: Observability-Alerting; removed SRE Observability.
Thu, Jan 13, 2:05 PM · Observability-Alerting
lmata moved T296199: Prometheus hardware refresh (+ Bullseye upgrade) from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:03 PM · Patch-For-Review, SRE Observability (FY2021/2022-Q3), User-fgiunchedi
lmata moved T228380: Tech debt: sunsetting of Graphite (part 1) from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3), User-fgiunchedi
lmata moved T274668: Standardize a SLI metrics naming/storage/mapping scheme from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata moved T289071: SRE Training checklist: logging from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata moved T288617: Metrics at the WMF are consolidated on the Prometheus stack and dashboards are managed as code from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata moved T289072: SRE Training checklist: alerting from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata removed a project from T288617: Metrics at the WMF are consolidated on the Prometheus stack and dashboards are managed as code: Goal.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata moved T288623: Observability tools are easy to use, docs easy to read, help easy to find. from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)
lmata moved T281454: Onboard teams with Prometheus-based alerts to AlertManager from FY2021/2022-Q2 to FY2021/2022-Q3 on the SRE Observability board.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3), Discovery-Search, Wikidata, Wikidata-Query-Service, User-fgiunchedi
lmata removed a project from T288623: Observability tools are easy to use, docs easy to read, help easy to find.: Goal.
Thu, Jan 13, 2:02 PM · SRE Observability (FY2021/2022-Q3)