Page MenuHomePhabricator

colewhite (cwhite)
User

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Aug 21 2018, 6:05 PM (56 w, 4 d)
Availability
Available
LDAP User
Cwhite
MediaWiki User
Unknown

Recent Activity

Thu, Sep 19

colewhite updated the task description for T205870: Fully migrate >= 30% of producers off statsd.
Thu, Sep 19, 10:41 PM · Performance-Team (Radar), Patch-For-Review, observability, Operations
colewhite updated the task description for T205870: Fully migrate >= 30% of producers off statsd.
Thu, Sep 19, 10:41 PM · Performance-Team (Radar), Patch-For-Review, observability, Operations

Wed, Sep 18

colewhite updated the task description for T205870: Fully migrate >= 30% of producers off statsd.
Wed, Sep 18, 9:33 PM · Performance-Team (Radar), Patch-For-Review, observability, Operations

Thu, Sep 12

colewhite updated the task description for T205870: Fully migrate >= 30% of producers off statsd.
Thu, Sep 12, 10:42 PM · Performance-Team (Radar), Patch-For-Review, observability, Operations

Tue, Sep 10

colewhite added a comment to T227360: wikibase: Request raises 500 on commons.

I cannot reproduce this anymore. Resolving.

Tue, Sep 10, 5:51 PM · StructuredDataOnCommons, Wikidata-Campsite, Wikidata, Wikimedia-production-error
colewhite closed T227360: wikibase: Request raises 500 on commons as Resolved.
Tue, Sep 10, 5:51 PM · StructuredDataOnCommons, Wikidata-Campsite, Wikidata, Wikimedia-production-error

Tue, Sep 3

colewhite created T231953: Gerrit repositories mediawiki/services/service-runner and mediawiki/services/service-template-node appear abandoned.
Tue, Sep 3, 11:36 PM · Repository-Admins, Release-Engineering-Team (Development services), Release-Engineering-Team-TODO, Cleanup, Services, service-runner, Gerrit

Fri, Aug 30

colewhite created T231696: Please create operations/debs/prometheus-swagger-exporter.
Fri, Aug 30, 11:09 PM · Continuous-Integration-Config, GitHub-Mirrors, User-MarcoAurelio, Repository-Admins
colewhite updated the task description for T227540: b4-eqiad pdu refresh (Thursday 10/24 @11am UTC).
Fri, Aug 30, 8:58 PM · DC-Ops, Operations, ops-eqiad
colewhite closed T229357: Remove logster from cp* hosts, a subtask of T220116: Migrate all metrics originated by PoPs from statsd to Prometheus, as Resolved.
Fri, Aug 30, 8:49 PM · User-fgiunchedi, Operations, observability, Goal
colewhite closed T229357: Remove logster from cp* hosts as Resolved.
Fri, Aug 30, 8:49 PM · Operations, observability

Mon, Aug 26

colewhite archived P8978 service-checker.
Mon, Aug 26, 7:49 PM
colewhite edited P8978 service-checker.
Mon, Aug 26, 5:33 PM
colewhite updated the task description for T227541: b6-eqiad pdu refresh (Tuesday 9/10 @11am UTC).
Mon, Aug 26, 4:38 PM · DC-Ops, Operations, ops-eqiad
colewhite updated the task description for T227541: b6-eqiad pdu refresh (Tuesday 9/10 @11am UTC).
Mon, Aug 26, 4:38 PM · DC-Ops, Operations, ops-eqiad
colewhite created P8978 service-checker.
Mon, Aug 26, 3:19 PM

Aug 13 2019

colewhite placed T230104: Requesting access to LogStash for Abijeet Patro up for grabs.
Aug 13 2019, 6:56 PM · SRE-Access-Requests, Operations

Aug 9 2019

colewhite closed T230242: Membership to 'wmf' LDAP group request for Connie Chen as Resolved.
Aug 9 2019, 9:15 PM · LDAP-Access-Requests, Operations
colewhite updated subscribers of T230242: Membership to 'wmf' LDAP group request for Connie Chen.

@cchen is now in the wmf ldap group. Resolving task.

Aug 9 2019, 9:15 PM · LDAP-Access-Requests, Operations
colewhite updated the task description for T230242: Membership to 'wmf' LDAP group request for Connie Chen.
Aug 9 2019, 9:13 PM · LDAP-Access-Requests, Operations
colewhite triaged T230242: Membership to 'wmf' LDAP group request for Connie Chen as Normal priority.
Aug 9 2019, 9:12 PM · LDAP-Access-Requests, Operations
colewhite closed T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen as Resolved.
Aug 9 2019, 9:11 PM · SRE-Access-Requests, Operations
colewhite added a comment to T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen.

Access to Superset and Turnilo are managed by the 'wmf' LDAP group. Since it is beyond the scope of this task, your new access request can be found here: T230242

Aug 9 2019, 9:11 PM · SRE-Access-Requests, Operations
colewhite created T230242: Membership to 'wmf' LDAP group request for Connie Chen.
Aug 9 2019, 9:06 PM · LDAP-Access-Requests, Operations
colewhite added a comment to T229963: Add Anne Tomasevich to ldap/wmf group.

Based on what I could find about your position, you may need more access than indicated here. @MarkTraceur could you help?

Aug 9 2019, 5:50 PM · LDAP-Access-Requests
colewhite claimed T229357: Remove logster from cp* hosts.
Aug 9 2019, 4:38 PM · Operations, observability
colewhite added a project to T230075: Setting up static maintenance page on Foundation servers for Foundation website: Traffic.
Aug 9 2019, 4:30 PM · Traffic, wikimediafoundation.org, Operations, Security
colewhite removed a project from T230173: Help speed up onboarding for new Analysts: SRE-Access-Requests.
Aug 9 2019, 4:20 PM · WMF-CTO-Team-Backlog, Product-Analytics
colewhite closed T230183: Remove MaxSem from map servers as Resolved.
Aug 9 2019, 4:20 PM · Maps, SRE-Access-Requests, Operations
colewhite updated the task description for T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro.
Aug 9 2019, 3:47 PM · SRE-Access-Requests, Operations
colewhite added a comment to T229959: Request for access of JAnstee to the `wmf` LDAP group.

Added to wmf ldap group. Resolving task.

Aug 9 2019, 3:46 PM · LDAP-Access-Requests
colewhite closed T229959: Request for access of JAnstee to the `wmf` LDAP group as Resolved.
Aug 9 2019, 3:45 PM · LDAP-Access-Requests

Aug 8 2019

colewhite claimed T229963: Add Anne Tomasevich to ldap/wmf group.
Aug 8 2019, 7:49 PM · LDAP-Access-Requests
colewhite added a comment to T229963: Add Anne Tomasevich to ldap/wmf group.

Hi AnneT!

Aug 8 2019, 7:49 PM · LDAP-Access-Requests
colewhite closed T229749: Yoruba Wikimedians User Group Official Mailing List as Resolved.
Aug 8 2019, 5:51 PM · Operations, Wikimedia-Mailing-lists
colewhite added a comment to T229749: Yoruba Wikimedians User Group Official Mailing List.

Mailing list has been provisioned and the list administrator password emailed to reachout2isaac and jerrykufang22 at gmail. Please let us know if you encounter trouble accessing.

Aug 8 2019, 5:51 PM · Operations, Wikimedia-Mailing-lists
colewhite claimed T229749: Yoruba Wikimedians User Group Official Mailing List.
Aug 8 2019, 5:47 PM · Operations, Wikimedia-Mailing-lists
colewhite added a comment to T230104: Requesting access to LogStash for Abijeet Patro.

Assuming NDA approval from T230020 once it is available.

Aug 8 2019, 5:46 PM · SRE-Access-Requests, Operations
colewhite claimed T230104: Requesting access to LogStash for Abijeet Patro.
Aug 8 2019, 5:45 PM · SRE-Access-Requests, Operations
colewhite updated subscribers of T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro.

@RStallman-legalteam Would you mind confirming NDA on file for Abijeet?

Aug 8 2019, 5:37 PM · SRE-Access-Requests, Operations
colewhite added a comment to T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro.

Please indicate on this task which roles/groups you are requesting membership of.

Aug 8 2019, 5:32 PM · SRE-Access-Requests, Operations
colewhite updated the task description for T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro.
Aug 8 2019, 5:13 PM · SRE-Access-Requests, Operations
colewhite updated the task description for T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro.
Aug 8 2019, 5:13 PM · SRE-Access-Requests, Operations
colewhite closed T228542: New Mailing lists for AzWiki sysops as Resolved.
Aug 8 2019, 4:53 PM · Operations, Wikimedia-Mailing-lists
colewhite added a comment to T228542: New Mailing lists for AzWiki sysops.

The list has been created and the list administrators password has been emailed to azimoveldar085 and wertuose gmail addresses. Please let us know if you have trouble accessing it.

Aug 8 2019, 4:53 PM · Operations, Wikimedia-Mailing-lists
colewhite claimed T228542: New Mailing lists for AzWiki sysops.
Aug 8 2019, 4:52 PM · Operations, Wikimedia-Mailing-lists
colewhite added a comment to T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen.

Group membership change has been deployed.

Aug 8 2019, 3:31 PM · SRE-Access-Requests, Operations
colewhite closed T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen as Resolved.
Aug 8 2019, 3:29 PM · SRE-Access-Requests, Operations
colewhite claimed T229959: Request for access of JAnstee to the `wmf` LDAP group.
Aug 8 2019, 3:07 PM · LDAP-Access-Requests
colewhite added a comment to T229959: Request for access of JAnstee to the `wmf` LDAP group.

Hi JAnstee!

Aug 8 2019, 3:07 PM · LDAP-Access-Requests

Aug 7 2019

colewhite updated the task description for T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen.
Aug 7 2019, 11:38 PM · SRE-Access-Requests, Operations
colewhite updated the task description for T228447: Requesting access to machines [stat1004, stat1007, stat1006, notebook1003 and notebook1004] and groups for cchen.
Aug 7 2019, 11:37 PM · SRE-Access-Requests, Operations
colewhite added a project to T229894: whitelist user Viztor[S] in CI: Release-Engineering-Team.
Aug 7 2019, 11:29 PM · Continuous-Integration-Config, Release-Engineering-Team-TODO, Release-Engineering-Team (CI & Testing services)
colewhite edited projects for T229894: whitelist user Viztor[S] in CI, added: cloud-services-team (Kanban); removed SRE-Access-Requests.
Aug 7 2019, 11:28 PM · Continuous-Integration-Config, Release-Engineering-Team-TODO, Release-Engineering-Team (CI & Testing services)
colewhite triaged T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro as Normal priority.
Aug 7 2019, 11:27 PM · SRE-Access-Requests, Operations
colewhite moved T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro from Awaiting User Input to Manager/NDA Approval/Confirmation on the SRE-Access-Requests board.
Aug 7 2019, 11:27 PM · SRE-Access-Requests, Operations
colewhite moved T230020: Requesting access to Mwmaint1002, Stat1007 for Abijeet Patro from Untriaged to Awaiting User Input on the SRE-Access-Requests board.
Aug 7 2019, 11:27 PM · SRE-Access-Requests, Operations
colewhite triaged T230002: puppetdb queue size went up since July 30 as Normal priority.
Aug 7 2019, 11:26 PM · Patch-For-Review, Operations
colewhite closed T229997: install2002 short on disk space, a subtask of T211850: install2002 94% disk usage on "/", as Resolved.
Aug 7 2019, 6:00 PM · Operations
colewhite closed T229997: install2002 short on disk space as Resolved.
Aug 7 2019, 6:00 PM · Operations
colewhite added a comment to T229997: install2002 short on disk space.

It looks like this has happened before, so I linked the case.

Aug 7 2019, 6:00 PM · Operations
colewhite claimed T229997: install2002 short on disk space.
Aug 7 2019, 5:37 PM · Operations
colewhite added a subtask for T211850: install2002 94% disk usage on "/": T229997: install2002 short on disk space.
Aug 7 2019, 5:37 PM · Operations
colewhite added a parent task for T229997: install2002 short on disk space: T211850: install2002 94% disk usage on "/".
Aug 7 2019, 5:37 PM · Operations

Aug 5 2019

colewhite reassigned T227529: Request rename of "waldir" to "waldyrious" on LDAP from waldyrious to thcipriani.
Aug 5 2019, 10:31 PM · LDAP-Access-Requests
colewhite added a comment to T228935: add john clark to wmf ldap group.

The requisite changes appear to have been completed. Closing.

Aug 5 2019, 10:26 PM · LDAP-Access-Requests
colewhite closed T228935: add john clark to wmf ldap group as Resolved.
Aug 5 2019, 10:23 PM · LDAP-Access-Requests
colewhite added a project to T229143: Access to HUE for Mayakpwiki: Operations.
Aug 5 2019, 10:21 PM · Operations, Analytics
colewhite removed projects from T229143: Access to HUE for Mayakpwiki: Operations, SRE-Access-Requests.
Aug 5 2019, 10:21 PM · Operations, Analytics
colewhite updated the task description for T227539: b3-eqiad pdu refresh (Tuesday 9/17 @11am UTC).
Aug 5 2019, 7:02 PM · DC-Ops, Operations, ops-eqiad

Jul 31 2019

colewhite claimed T205870: Fully migrate >= 30% of producers off statsd.
Jul 31 2019, 8:46 PM · Performance-Team (Radar), Patch-For-Review, observability, Operations

Jul 30 2019

colewhite added projects to T229357: Remove logster from cp* hosts: observability, Operations.
Jul 30 2019, 11:07 PM · Operations, observability
colewhite updated the task description for T220116: Migrate all metrics originated by PoPs from statsd to Prometheus.
Jul 30 2019, 4:48 PM · User-fgiunchedi, Operations, observability, Goal
colewhite reopened T220116: Migrate all metrics originated by PoPs from statsd to Prometheus, a subtask of T220104: TEC6: Metrics monitoring infrastructure (Q4 2018/19 goal), as Open.
Jul 30 2019, 4:47 PM · User-fgiunchedi, Operations, observability, Goal
colewhite reopened T220116: Migrate all metrics originated by PoPs from statsd to Prometheus as "Open".
Jul 30 2019, 4:47 PM · User-fgiunchedi, Operations, observability, Goal
colewhite added a subtask for T220116: Migrate all metrics originated by PoPs from statsd to Prometheus: T229357: Remove logster from cp* hosts.
Jul 30 2019, 4:47 PM · User-fgiunchedi, Operations, observability, Goal
colewhite added a parent task for T229357: Remove logster from cp* hosts: T220116: Migrate all metrics originated by PoPs from statsd to Prometheus.
Jul 30 2019, 4:47 PM · Operations, observability
colewhite created T229357: Remove logster from cp* hosts.
Jul 30 2019, 4:46 PM · Operations, observability
colewhite closed T220116: Migrate all metrics originated by PoPs from statsd to Prometheus, a subtask of T220104: TEC6: Metrics monitoring infrastructure (Q4 2018/19 goal), as Resolved.
Jul 30 2019, 4:34 PM · User-fgiunchedi, Operations, observability, Goal
colewhite closed T220116: Migrate all metrics originated by PoPs from statsd to Prometheus as Resolved.
Jul 30 2019, 4:34 PM · User-fgiunchedi, Operations, observability, Goal

Jul 29 2019

colewhite added a comment to T196066: Add prometheus metrics for varnishkafka instances running on caching hosts.

Sounds good to me! Happy to help however I can, just let me know.

Jul 29 2019, 5:24 PM · Patch-For-Review, Analytics-Kanban, Traffic, Operations, Analytics
colewhite closed T196066: Add prometheus metrics for varnishkafka instances running on caching hosts, a subtask of T220116: Migrate all metrics originated by PoPs from statsd to Prometheus, as Resolved.
Jul 29 2019, 3:38 PM · User-fgiunchedi, Operations, observability, Goal
colewhite closed T196066: Add prometheus metrics for varnishkafka instances running on caching hosts as Resolved.
Jul 29 2019, 3:38 PM · Patch-For-Review, Analytics-Kanban, Traffic, Operations, Analytics

Jul 15 2019

colewhite added a comment to T228089: Logstash down for MediaWiki.

We decided to drop logs from cpjobqueue and changeprop at the logstash layer with the following config:

Jul 15 2019, 8:03 PM · Wikimedia-Incident, observability, Operations, Wikimedia-Logstash

Jul 10 2019

colewhite added a comment to T225604: log spam from mtail 3.0.0~rc19 on wezen.

@jbond there appears to be a missing feature around the -logfds flag in mtail rc24. This causes varnishmtail and varnishmtail-backend to fail to start because the -logfds flag is missing. Downgrading back to 3.0.0~rc5-1~bpo9+1wmf1 restores the flag and varnishmtail and varnishmtail-backend worked again.

Jul 10 2019, 11:12 PM · Patch-For-Review, observability

Jul 5 2019

colewhite created T227360: wikibase: Request raises 500 on commons.
Jul 5 2019, 8:49 PM · StructuredDataOnCommons, Wikidata-Campsite, Wikidata, Wikimedia-production-error

Jul 1 2019

colewhite added a comment to T213708: Upgrade production prometheus-node-exporter to >= 0.16.

@CDanis thanks for the heads up. Should look better now.

Jul 1 2019, 10:52 PM · Patch-For-Review, Goal, observability, Operations
colewhite added a comment to T226815: Gather metrics on request status codes, latencies from the MediaWiki appservers.

@Joe afaik, we're using mtail for this kind of metrics gathering. Some examples are the varnish programs here

Jul 1 2019, 4:42 PM · Patch-For-Review, Operations, observability, serviceops

Jun 26 2019

colewhite committed rODFRB52f28c095034: branched from tags/v2.0.0 and added debian directory (authored by colewhite).
branched from tags/v2.0.0 and added debian directory
Jun 26 2019, 4:20 PM
colewhite committed rODFRB94055a771cfe: branched from tags/v2.0.0 and added debian directory (authored by colewhite).
branched from tags/v2.0.0 and added debian directory
Jun 26 2019, 3:36 PM
colewhite committed rODFRBd15f7a2739d0: branched from tags/v2.0.0 and added debian directory (authored by colewhite).
branched from tags/v2.0.0 and added debian directory
Jun 26 2019, 2:10 PM

Jun 25 2019

colewhite committed rODFRBe96ce23c1129: branched from tags/v2.0.0 and added debian directory (authored by colewhite).
branched from tags/v2.0.0 and added debian directory
Jun 25 2019, 9:01 PM
colewhite added a comment to T226449: Please create operations/debs/file-read-backwards gerrit repository.

@MarcoAurelio Repo works for me. Thanks for the quick turnaround!

Jun 25 2019, 5:01 PM · User-MarcoAurelio, Repository-Admins
colewhite committed rODFRB0d62aaa86183: add debian folder (authored by colewhite).
add debian folder
Jun 25 2019, 5:01 PM
colewhite committed rODFRBaca5baf2392f: Merge https://github.com/RobinNil/file_read_backwards (authored by colewhite).
Merge https://github.com/RobinNil/file_read_backwards
Jun 25 2019, 4:16 PM

Jun 24 2019

colewhite created T226449: Please create operations/debs/file-read-backwards gerrit repository.
Jun 24 2019, 9:01 PM · User-MarcoAurelio, Repository-Admins

Jun 6 2019

colewhite added a comment to T184942: Deprecate python varnish cachestats.

Latest dashboard audit:

Jun 6 2019, 10:28 PM · Patch-For-Review, Traffic, User-fgiunchedi, Goal, Operations

Jun 5 2019

bd808 awarded T216088: Mapping of servers to stakeholders a Love token.
Jun 5 2019, 7:14 PM · Operations

Jun 4 2019

colewhite added a comment to T219825: Update dashboards to node-exporter 0.16+ metric names.

Thanks for the report! I've gone through and updated dashboards where I've found the legacy metric names in dashboard variables. Please let me know if you find any additional instances.

Jun 4 2019, 12:03 AM · Patch-For-Review, observability

May 29 2019

colewhite closed T219825: Update dashboards to node-exporter 0.16+ metric names as Resolved.
May 29 2019, 6:01 PM · Patch-For-Review, observability