Page MenuHomePhabricator
Feed Advanced Search

Jun 20 2018

Joe added a member for acl*sre-team: Vgutierrez.
Jun 20 2018, 7:42 AM
chasemp added a member for acl*sre-team: Vgutierrez.
Jun 20 2018, 7:42 AM

Apr 26 2018

MoritzMuehlenhoff removed a member for acl*sre-team: madhuvishy.
Apr 26 2018, 7:15 AM

Feb 5 2018

RobH edited Description on acl*sre-team.
Feb 5 2018, 6:46 PM
RobH removed a member for acl*sre-team: ori.
Feb 5 2018, 6:45 PM
RobH edited Description on acl*sre-team.
Feb 5 2018, 6:45 PM
Dzahn added a member for acl*sre-team: Bstorm.
Feb 5 2018, 6:36 PM

Jan 16 2018

chasemp added a member for acl*sre-team: aborrero.
Jan 16 2018, 4:04 PM

Jun 19 2017

yuvipanda removed a member for acl*sre-team: yuvipanda.
Jun 19 2017, 6:15 PM

May 30 2017

Dzahn added a member for acl*sre-team: herron.
May 30 2017, 5:55 PM

Apr 3 2017

Dzahn added a member for acl*sre-team: ayounsi.
Apr 3 2017, 7:14 PM

Dec 14 2016

Matanya added a watcher for acl*sre-team: Matanya.
Dec 14 2016, 12:42 PM
Matanya added a watcher for acl*sre-team: Matanya.
Dec 14 2016, 12:42 PM

Nov 15 2016

RobH added a member for acl*sre-team: elukey.
Nov 15 2016, 5:19 PM

Sep 1 2016

RobH added a member for acl*sre-team: Marostegui.
Sep 1 2016, 5:50 PM

Jul 18 2016

chasemp added a member for acl*sre-team: madhuvishy.
Jul 18 2016, 1:20 PM

May 17 2016

RobH removed a member for acl*sre-team: coren.
May 17 2016, 5:17 PM

May 8 2016

ori changed the visibility for T123159: ops access request (T123158).
May 8 2016, 1:39 AM · Trash

Mar 29 2016

RobH added a member for acl*sre-team: Volans.
Mar 29 2016, 5:46 PM

Feb 10 2016

RobH closed T123159: ops access request (T123158) as Resolved.
Feb 10 2016, 8:13 PM · Trash

Jan 13 2016

PhiLiP added a project to T123223: Install Noto CJK (Source Han Sans) font family for SVG rendering: acl*sre-team.
Jan 13 2016, 10:27 AM · Patch-For-Review, SRE, Wikimedia-SVG-rendering

Jan 11 2016

Dzahn added a member for acl*sre-team: ema.
Jan 11 2016, 9:00 PM

Dec 19 2015

revi closed T121973: clip.dj as Invalid.
Dec 19 2015, 12:15 PM · Trash
LordLSDlite created T121975: fulcontrol.
Dec 19 2015, 12:12 PM · Trash
LordLSDlite renamed T121973: clip.dj from to clip.dj.
Dec 19 2015, 12:10 PM · Trash

Nov 19 2015

Krenair added a comment to T99958: [EPIC] Five teams sample their maintenance fraction and two teams track it throughout the quarter.

Not a restricted task

Nov 19 2015, 10:18 PM · Team-Practices (This-Week), Phlogiston-Category, Epic
JAufrecht added a project to T99958: [EPIC] Five teams sample their maintenance fraction and two teams track it throughout the quarter: Team-Practices.

Not all child tasks are done, so this stays in TPG epics in progress column.

Nov 19 2015, 10:09 PM · Team-Practices (This-Week), Phlogiston-Category, Epic
JAufrecht edited projects for T99958: [EPIC] Five teams sample their maintenance fraction and two teams track it throughout the quarter, added: acl*sre-team; removed Team-Practices (This-Week).
Nov 19 2015, 10:04 PM · Team-Practices (This-Week), Phlogiston-Category, Epic

Nov 13 2015

yuvipanda added a member for acl*sre-team: ori.
Nov 13 2015, 12:12 AM

Nov 12 2015

jcrespo removed a member for acl*sre-team: ori.
Nov 12 2015, 10:32 AM

Nov 3 2015

Halfak updated subscribers of T117560: New Service Request: ORES.
Nov 3 2015, 4:19 PM · Machine-Learning-Team (Active Tasks), Services, Service-deployment-requests, SRE
Halfak added a subtask for T117560: New Service Request: ORES: T115534: Set up backpressure for ORES (Limit queue sizes in Celery).
Nov 3 2015, 4:18 PM · Machine-Learning-Team (Active Tasks), Services, Service-deployment-requests, SRE
Halfak added a subtask for T117560: New Service Request: ORES: T110072: Security Review of Revscoring.
Nov 3 2015, 4:17 PM · Machine-Learning-Team (Active Tasks), Services, Service-deployment-requests, SRE
Halfak created T117560: New Service Request: ORES.
Nov 3 2015, 4:16 PM · Machine-Learning-Team (Active Tasks), Services, Service-deployment-requests, SRE

Oct 21 2015

chasemp closed T116210: test task as Invalid.
Oct 21 2015, 6:52 PM · Trash
chasemp removed a project from T110474: Decom parsoid-lb.eqiad.wikimedia.org entrypoint: acl*sre-team.
Oct 21 2015, 6:24 PM · SRE, Patch-For-Review, Wikimedia-IEG-grant-review, VisualEditor, Parsoid, Traffic
admin edited Description on acl*sre-team.
Oct 21 2015, 6:23 PM
admin edited Description on acl*sre-team.
Oct 21 2015, 6:22 PM
admin edited Description on acl*sre-team.
Oct 21 2015, 6:22 PM
chasemp edited projects for T116210: test task, added: acl*sre-team; removed SRE.
Oct 21 2015, 6:21 PM · Trash
chasemp edited Description on acl*sre-team.
Oct 21 2015, 6:18 PM
chasemp removed a project from T110474: Decom parsoid-lb.eqiad.wikimedia.org entrypoint: acl*sre-team.
Oct 21 2015, 6:16 PM · SRE, Patch-For-Review, Wikimedia-IEG-grant-review, VisualEditor, Parsoid, Traffic
chasemp added a project to T98327: project shuffle test task: acl*sre-team.
Oct 21 2015, 6:15 PM · Trash
mobrovac closed T110711: RESTBase test suite can't use parsoid-lb endpoint, a subtask of T110474: Decom parsoid-lb.eqiad.wikimedia.org entrypoint, as Resolved.
Oct 21 2015, 6:14 PM · SRE, Patch-For-Review, Wikimedia-IEG-grant-review, VisualEditor, Parsoid, Traffic
chasemp set the icon for acl*sre-team to fa-lock.
Oct 21 2015, 6:12 PM
chasemp changed hashtags for acl*sre-team, added #opsacl, #aclops; removed #operations, #ops, #opsen.
Oct 21 2015, 6:06 PM
chasemp renamed acl*sre-team from operations to acl*operations-team.
Oct 21 2015, 6:05 PM
Nuria moved T114370: Flag in x-analytics in varnish any request that comes with no cookies whatsoever {bear} [5 pts] from In Code Review to Done on the Analytics-Kanban board.
Oct 21 2015, 5:54 PM · SRE, Patch-For-Review, Traffic, Analytics-Kanban
Krinkle added a project to T116132: Consider allowing H2 coalesce for upload.wikimedia.org for images used in wiki articles: Performance Issue.
Oct 21 2015, 5:01 PM · Performance-Team, Wikimedia-Performance-publish, Traffic-Icebox, SRE
Dzahn added a comment to T116169: Grant Joseph and Dan deploy permissions on aqs100[1-3].

@Milimetric or @Ottomata could you list the commands needed for deployment?

Oct 21 2015, 4:32 PM · SRE-Access-Requests, SRE
Dzahn added a comment to T116169: Grant Joseph and Dan deploy permissions on aqs100[1-3].

This sounds like we need a new admin group that does not exist yet.

Oct 21 2015, 4:31 PM · SRE-Access-Requests, SRE
Andrew closed T101803: wikitech-static sync broken as Resolved.

All green, and I've made the test less touchy. So, closing this bug for now.

Oct 21 2015, 4:29 PM · SRE, Patch-For-Review, Wikimedia-Apache-configuration, Cloud-VPS, wikitech.wikimedia.org, Cloud-Services
Dzahn triaged T116169: Grant Joseph and Dan deploy permissions on aqs100[1-3] as Medium priority.
Oct 21 2015, 4:26 PM · SRE-Access-Requests, SRE
Dzahn claimed T116169: Grant Joseph and Dan deploy permissions on aqs100[1-3].
Oct 21 2015, 4:26 PM · SRE-Access-Requests, SRE
Dzahn added a comment to T115666: Requesting access to stat1003, stat1002 and bast1001 for AGomez (WMF).

@atgo did you get to create a key yet?

Oct 21 2015, 4:26 PM · SRE, SRE-Access-Requests
Dzahn added a comment to T115666: Requesting access to stat1003, stat1002 and bast1001 for AGomez (WMF).

thanks @Ottomata. amended the change

Oct 21 2015, 4:24 PM · SRE, SRE-Access-Requests
gerritbot added a comment to T101803: wikitech-static sync broken.

Change 247863 merged by Dzahn:
Allow wikitech-static to drift a bit more than two days away from wikitech.

Oct 21 2015, 4:20 PM · SRE, Patch-For-Review, Wikimedia-Apache-configuration, Cloud-VPS, wikitech.wikimedia.org, Cloud-Services
gerritbot added a comment to T101803: wikitech-static sync broken.

Change 247863 had a related patch set uploaded (by Andrew Bogott):
Allow wikitech-static to drift a bit more than two days away from wikitech.

Oct 21 2015, 4:16 PM · SRE, Patch-For-Review, Wikimedia-Apache-configuration, Cloud-VPS, wikitech.wikimedia.org, Cloud-Services
Ottomata moved T83580: Overhaul reqstats from In Progress to Done on the Analytics-Kanban board.
Oct 21 2015, 4:04 PM · SRE, Analytics-Kanban, Patch-For-Review, observability
gerritbot added a comment to T116184: mw1083's sda disk is dying.

Change 247859 merged by Alexandros Kosiaris:
mw1083: depooled, remove from dsh

Oct 21 2015, 4:00 PM · SRE, ops-eqiad
gerritbot added a project to T116184: mw1083's sda disk is dying: Patch-For-Review.
Oct 21 2015, 3:59 PM · SRE, ops-eqiad
gerritbot added a comment to T116184: mw1083's sda disk is dying.

Change 247859 had a related patch set uploaded (by Alexandros Kosiaris):
mw1083: depooled, remove from dsh

Oct 21 2015, 3:59 PM · SRE, ops-eqiad
akosiaris triaged T116184: mw1083's sda disk is dying as Medium priority.
Oct 21 2015, 3:42 PM · SRE, ops-eqiad
akosiaris created T116184: mw1083's sda disk is dying.
Oct 21 2015, 3:42 PM · SRE, ops-eqiad
faidon added a comment to T116111: ganeti: PROCS CRITICAL: 2 processes ....

Pretty sure it's Ganeti's watcher running via cron.

Oct 21 2015, 3:35 PM · SRE, Icinga
faidon placed T80890: fix/streamline mail routing off of neon up for grabs.
Oct 21 2015, 3:34 PM · Infrastructure-Foundations, SRE, Mail
faidon lowered the priority of T80890: fix/streamline mail routing off of neon from Medium to Low.

It's still a valid bug, however we now have multiple outgoing relays so it's less of a concern.

Oct 21 2015, 3:34 PM · Infrastructure-Foundations, SRE, Mail
Dzahn added a comment to T116111: ganeti: PROCS CRITICAL: 2 processes ....

eh, fair, i just happened to see it in web ui. it was probably always just a SOFT state and did not trigger a notification. yes

Oct 21 2015, 2:59 PM · SRE, Icinga
akosiaris claimed T116111: ganeti: PROCS CRITICAL: 2 processes ....

Hmm, so this never really triggers an alert because after a single recheck it is back to normal. Need to figure out what triggers the second process. It probably is not the monitoring.

Oct 21 2015, 2:58 PM · SRE, Icinga
Milimetric created T116169: Grant Joseph and Dan deploy permissions on aqs100[1-3].
Oct 21 2015, 1:51 PM · SRE-Access-Requests, SRE
Steinsplitter added a comment to T74109: Upgrade OTRS to a more recent stable release.

https://www.otrs.com/release-notes-otrs-5/

Oct 21 2015, 1:46 PM · User-notice-archive, Patch-For-Review, SRE, Znuny
Steinsplitter renamed T74109: Upgrade OTRS to a more recent stable release from Upgrade OTRS to latest stable release (4.0 or later) to Upgrade OTRS to latest stable release (5.0 or later).
Oct 21 2015, 1:46 PM · User-notice-archive, Patch-For-Review, SRE, Znuny
saper created T116163: FeaturedFeedsWMF.php should be available via noc.wikimedia.org.
Oct 21 2015, 1:36 PM · Patch-For-Review, Wikimedia-Site-requests
hashar added a comment to T95046: install/deploy scandium as zuul merger (ci) server.

Note the zuul-merger process on scandium will need to be able to reach the Gearman server on gallium (production).

Oct 21 2015, 1:32 PM · OKR-Work, SRE, Continuous-Integration-Scaling
gerritbot added a comment to T114370: Flag in x-analytics in varnish any request that comes with no cookies whatsoever {bear} [5 pts].

Change 244626 merged by BBlack:
Mark incoming requests without cookies in x-analytics

Oct 21 2015, 1:29 PM · SRE, Patch-For-Review, Traffic, Analytics-Kanban
Ottomata added a comment to T115666: Requesting access to stat1003, stat1002 and bast1001 for AGomez (WMF).

Since this explicitly asks for stat1003 and stat1002, atgo will also need to be in the statistics-users group. That will give access to stat1003.

Oct 21 2015, 1:13 PM · SRE, SRE-Access-Requests
JanZerebecki moved T114443: EventBus MVP from incoming to hold on the Wikidata board.
Oct 21 2015, 12:48 PM · Analytics-Radar, TechCom-RFC (TechCom-RFC-Closed), Proposal, SRE, Wikidata-Query-Service, Service-Architecture, Services, MediaWiki-General, Wikidata, Epic, Discovery-ARCHIVED, Event-Platform
hashar added a comment to T113785: Make the Shinken IRC alert and icinga-wm bots use colors.

Seems the notification commands are defined in puppet modules/nagios_common/templates/notification_commands.cfg.erb and simply append to a file that is then processed by some IRC bot.

define command{
    command_name    notify-host-by-irc
    command_line    echo "$NOTIFICATIONTYPE$ - Host $HOSTALIAS$ is $HOSTSTATE$: $HOSTOUTPUT$ $HOSTACKAUTHOR$ $HOSTACKCOMMENT$" >> <%= @irc_dir_path %>/irc.log
    }
Oct 21 2015, 9:46 AM · SRE, Shinken
tstarling moved T114443: EventBus MVP from Request IRC meeting to Under discussion on the TechCom-RFC board.
Oct 21 2015, 9:38 AM · Analytics-Radar, TechCom-RFC (TechCom-RFC-Closed), Proposal, SRE, Wikidata-Query-Service, Service-Architecture, Services, MediaWiki-General, Wikidata, Epic, Discovery-ARCHIVED, Event-Platform
gerritbot added a comment to T99485: implement performance_schema for mysql monitoring.

Change 247615 merged by Jcrespo:
Enabling performance schema experimentally on db1018

Oct 21 2015, 9:24 AM · Prometheus-metrics-monitoring, SRE, Patch-For-Review, DBA
jcrespo raised the priority of T109069: TokuDB crashes frequently -consider upgrade it or search for alternative engines with similar features from Medium to High.

Last issue that broke replication on dbstore1001:

Oct 21 2015, 9:14 AM · Upstream, SRE, DBA
Pginer-WMF moved T101272: Standardise CXServer deployment from Backlog to In Review on the LE-CX7-Sprint 2 board.
Oct 21 2015, 7:14 AM · LE-CX7-Sprint 4, SRE, Patch-For-Review, ContentTranslation-Release7, OKR-Work, ContentTranslation, ContentTranslation-Deployments, service-template-node, service-runner, ContentTranslation-CXserver, Services
Amire80 edited projects for T101272: Standardise CXServer deployment, added: LE-CX7-Sprint 2; removed LE-CX7-Sprint 1.
Oct 21 2015, 7:14 AM · LE-CX7-Sprint 4, SRE, Patch-For-Review, ContentTranslation-Release7, OKR-Work, ContentTranslation, ContentTranslation-Deployments, service-template-node, service-runner, ContentTranslation-CXserver, Services
Dzahn added a comment to T113785: Make the Shinken IRC alert and icinga-wm bots use colors.

colors for icinga-wm as well. wikibugs has them. so yay

Oct 21 2015, 6:43 AM · SRE, Shinken
Dzahn lowered the priority of T113785: Make the Shinken IRC alert and icinga-wm bots use colors from Medium to Low.
Oct 21 2015, 6:41 AM · SRE, Shinken
Dzahn added a comment to T84163: Fix CirrusSearch monitoring.

I scheduled a downtime for this service of 1 month with a link to this ticket.

Oct 21 2015, 6:37 AM · Observability-Alerting, SRE, Discovery-ARCHIVED
Dzahn added a comment to T80890: fix/streamline mail routing off of neon.

on neon:

Oct 21 2015, 6:31 AM · Infrastructure-Foundations, SRE, Mail
Dzahn changed the visibility for T80890: fix/streamline mail routing off of neon.
Oct 21 2015, 6:30 AM · Infrastructure-Foundations, SRE, Mail
Dzahn added projects to T80890: fix/streamline mail routing off of neon: Icinga, Mail.
Oct 21 2015, 6:29 AM · Infrastructure-Foundations, SRE, Mail
Dzahn assigned T80890: fix/streamline mail routing off of neon to faidon.

@faidon this must be long time ago, right. can you confirm this should be closed?

Oct 21 2015, 6:28 AM · Infrastructure-Foundations, SRE, Mail
Dzahn updated subscribers of T82937: CLI script for manual paging.
Oct 21 2015, 6:26 AM · Observability-Alerting, User-CDanis, SRE, Icinga
Dzahn changed the visibility for T82937: CLI script for manual paging.
Oct 21 2015, 6:26 AM · Observability-Alerting, User-CDanis, SRE, Icinga
Dzahn added projects to T82937: CLI script for manual paging: Icinga, observability.
Oct 21 2015, 6:25 AM · Observability-Alerting, User-CDanis, SRE, Icinga
Dzahn lowered the priority of T82288: use rkhunter/chkrootkit and have monitoring for it from Medium to Low.
Oct 21 2015, 6:24 AM · Security, SRE, observability
Dzahn added a project to T82499: give icinga a "login" link: Icinga.
Oct 21 2015, 6:22 AM · SRE, Icinga, observability
Dzahn closed T82499: give icinga a "login" link as Declined.
Oct 21 2015, 6:22 AM · SRE, Icinga, observability
Dzahn triaged T116132: Consider allowing H2 coalesce for upload.wikimedia.org for images used in wiki articles as Low priority.
Oct 21 2015, 6:10 AM · Performance-Team, Wikimedia-Performance-publish, Traffic-Icebox, SRE
Dzahn added a comment to T94896: Optimize prod's resource domains for SPDY/HTTP2.

new one about eventually looking at the specific upload problem.

Oct 21 2015, 6:08 AM · SRE, Performance-Team, Traffic, Performance Issue
Dzahn updated the task description for T116132: Consider allowing H2 coalesce for upload.wikimedia.org for images used in wiki articles.
Oct 21 2015, 6:07 AM · Performance-Team, Wikimedia-Performance-publish, Traffic-Icebox, SRE
Dzahn created T116132: Consider allowing H2 coalesce for upload.wikimedia.org for images used in wiki articles.
Oct 21 2015, 6:06 AM · Performance-Team, Wikimedia-Performance-publish, Traffic-Icebox, SRE