Page MenuHomePhabricator

jijiki (effie mouzeli)
is an animal

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Monday

  • Clear sailing ahead.

User Details

User Since
Aug 14 2018, 10:50 AM (48 w, 4 d)
Availability
Available
IRC Nick
jijiki
LDAP User
Effie Mouzeli
MediaWiki User
EMouzeli (WMF) [ Global Accounts ]

Recent Activity

Yesterday

jijiki added a comment to T227408: (OoW) restbase2009 lockup.

@Eevans Shall we mark restbase2009 as inactive on conftool?

Fri, Jul 19, 9:59 AM · serviceops, ops-codfw, Operations
jijiki added projects to T180696: Terminate Thumbor with SSL: serviceops, User-jijiki.

TLS on haproxy it is then:)

Fri, Jul 19, 9:46 AM · User-jijiki, serviceops, Performance-Team (Radar), Thumbor
jijiki moved T91474: Custom 404 error page should apply to *.php from Backlog to Next up on the serviceops board.
Fri, Jul 19, 8:57 AM · serviceops, User-jijiki, Regression, Wikimedia-General-or-Unknown
jijiki moved T210143: Canaries canaries canaries from Backlog to Goal tasks on the serviceops board.
Fri, Jul 19, 8:57 AM · serviceops, Operations
jijiki moved T227408: (OoW) restbase2009 lockup from Backlog to Next up on the serviceops board.
Fri, Jul 19, 8:56 AM · serviceops, ops-codfw, Operations
jijiki moved T228196: docker-registry: some layers has been corrupted due to deleting other swift containers from Backlog to Next up on the serviceops board.
Fri, Jul 19, 8:49 AM · Patch-For-Review, Release-Engineering-Team-TODO (201907), Operations, Wikimedia-Incident, serviceops
jijiki moved T228328: 'scap pull' stopped working on appservers ? from Backlog to Externally Blocked on the serviceops board.
Fri, Jul 19, 8:48 AM · Release-Engineering-Team-TODO (201907), Release-Engineering-Team (Deployment services), Scap, serviceops
jijiki moved T223336: [Regression] fatal-errors.php action=segfault results in a 503 error under php7-fpm. from Backlog to Next up on the serviceops board.
Fri, Jul 19, 8:48 AM · Performance-Team (Radar), serviceops, User-jijiki, observability, Operations, PHP 7.2 support

Thu, Jul 18

jijiki added a project to T228303: Redis exception connecting to "/var/run/nutcracker/redis_eqiad.sock": read error on connection: serviceops.
Thu, Jul 18, 4:29 PM · MW-1.34-notes (1.34.0-wmf.15; 2019-07-23), serviceops, Operations, Performance-Team, MediaWiki-Cache, Wikimedia-production-error
jijiki updated the task description for T228436: web request timeout after 200 seconds due to Wikimedia\Rdbms\LBFactory->__destruct() > Wikimedia\Rdbms\LBFactory->commitMasterChanges().
Thu, Jul 18, 3:28 PM · Performance-Team, MediaWiki-Database, Wikimedia-production-error
jijiki closed T228063: Intermittent connect timeout for CirrusSearch connections, a subtask of T227691: Fatal from CirrusSearch\Job\LinksUpdate: "Call to a member function getLogVariables() on null", as Resolved.
Thu, Jul 18, 10:40 AM · MW-1.34-notes (1.34.0-wmf.14; 2019-07-16), Discovery-Search, CirrusSearch, Wikimedia-production-error
jijiki closed T228063: Intermittent connect timeout for CirrusSearch connections as Resolved.

Let's reopen if the issue persists.

Thu, Jul 18, 10:40 AM · serviceops, Discovery-Search, CirrusSearch

Wed, Jul 17

jijiki added a comment to T219148: Use PHP7 to run all async jobs.

After discussing with @Pchelolo, we believe that in order to migrate the rest, we could migrate ~25% of jobrunners in eqiad (6 servers) to serve only via PHP7. With this scenario, if we have jobs that are failing, they have a good chance of the job eventually running, since it will be retried a couple of times.

Wed, Jul 17, 8:05 AM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Wed, Jul 17, 8:00 AM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki moved T224538: Socket Errors on PHP7 from Doing to Next up on the serviceops board.
Wed, Jul 17, 7:59 AM · serviceops, Operations, PHP 7.2 support
jijiki moved T195392: Switch cronjobs on maintenance hosts to PHP7 from Doing to Next up on the serviceops board.
Wed, Jul 17, 7:59 AM · User-jijiki, cloud-services-team, Services (watching), serviceops, Core Platform Team Backlog (Watching / External), User-ArielGlenn, Operations
jijiki moved T228063: Intermittent connect timeout for CirrusSearch connections from Backlog to Doing on the serviceops board.
Wed, Jul 17, 7:21 AM · serviceops, Discovery-Search, CirrusSearch

Tue, Jul 16

jijiki added a project to T228196: docker-registry: some layers has been corrupted due to deleting other swift containers: Operations.
Tue, Jul 16, 8:09 PM · Patch-For-Review, Release-Engineering-Team-TODO (201907), Operations, Wikimedia-Incident, serviceops
jijiki added a project to T228196: docker-registry: some layers has been corrupted due to deleting other swift containers: Wikimedia-Incident.
Tue, Jul 16, 8:08 PM · Patch-For-Review, Release-Engineering-Team-TODO (201907), Operations, Wikimedia-Incident, serviceops

Mon, Jul 15

jijiki added a comment to T227867: mw1239 memory errors .

Thank you!

Mon, Jul 15, 9:57 PM · ops-eqiad, DC-Ops, Operations, serviceops
jijiki reassigned T227867: mw1239 memory errors from jijiki to Cmjohnson.
Mon, Jul 15, 9:56 PM · ops-eqiad, DC-Ops, Operations, serviceops
jijiki updated the task description for T228063: Intermittent connect timeout for CirrusSearch connections.
Mon, Jul 15, 2:42 PM · serviceops, Discovery-Search, CirrusSearch
jijiki triaged T228063: Intermittent connect timeout for CirrusSearch connections as Normal priority.
Mon, Jul 15, 2:42 PM · serviceops, Discovery-Search, CirrusSearch
jijiki added a comment to T224538: Socket Errors on PHP7 .

Removing kafka1018 didn't fix the problem, still looking

Mon, Jul 15, 12:59 PM · serviceops, Operations, PHP 7.2 support

Sun, Jul 14

jijiki added a comment to T224491: PHP 7 corruption during deployment (was: PHP 7 fatals on mw1262).

@Krinkle Should we reopen this task then?

Sun, Jul 14, 6:32 AM · User-jijiki, serviceops, PHP 7.2 support, Performance-Team (Radar), Operations, Wikimedia-production-error

Fri, Jul 12

jijiki edited projects for T220246: Management of Cassandra schema and keyspace/table configuration, added: serviceops-radar; removed serviceops.
Fri, Jul 12, 1:14 PM · User-WDoran, Core Platform Team Workboards (Clinic Duty Team), serviceops-radar, Core Platform Team (Cassandra Operational )
jijiki added a project to T226551: Package table_properties utility for Debian: serviceops.
Fri, Jul 12, 1:12 PM · Core Platform Team Workboards (Clinic Duty Team), serviceops, Core Platform Team (Session Management Service (CDP2)), User-Clarakosi, User-Eevans
jijiki triaged T227867: mw1239 memory errors as Normal priority.
Fri, Jul 12, 11:09 AM · ops-eqiad, DC-Ops, Operations, serviceops
jijiki created T227867: mw1239 memory errors .
Fri, Jul 12, 11:07 AM · ops-eqiad, DC-Ops, Operations, serviceops
jijiki moved T219148: Use PHP7 to run all async jobs from Next up to Doing on the serviceops board.
Fri, Jul 12, 10:45 AM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki moved T187147: Port mediawiki/php/wmerrors to PHP7 and deploy from Doing to Next up on the serviceops board.
Fri, Jul 12, 10:44 AM · Core Platform Team Workboards (Clinic Duty Team), serviceops, Patch-For-Review, MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), wmerrors, Wikimedia-Logstash, MediaWiki-Logging, Operations, User-herron, PHP 7.2 support, Core Platform Team (PHP7 (TEC4)), Performance-Team (Radar)
jijiki moved T226373: Swift object servers become briefly unresponsive on a regular basis from Backlog to Next up on the serviceops board.
Fri, Jul 12, 8:16 AM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations
jijiki added a watcher for serviceops: jijiki.
Fri, Jul 12, 8:15 AM

Thu, Jul 11

jijiki added a project to T220246: Management of Cassandra schema and keyspace/table configuration: serviceops.
Thu, Jul 11, 3:29 PM · User-WDoran, Core Platform Team Workboards (Clinic Duty Team), serviceops-radar, Core Platform Team (Cassandra Operational )
jijiki moved T224538: Socket Errors on PHP7 from Next up to Doing on the serviceops board.
Thu, Jul 11, 7:42 AM · serviceops, Operations, PHP 7.2 support
jijiki updated the task description for T227306: Missing Documentation for Service Operations.
Thu, Jul 11, 7:40 AM · Documentation, serviceops
jijiki added a parent task for T216234: Clarify and document our docker image building process and policies.: T227306: Missing Documentation for Service Operations.
Thu, Jul 11, 7:40 AM · MediaWiki-Docker, serviceops
jijiki added a subtask for T227306: Missing Documentation for Service Operations: T216234: Clarify and document our docker image building process and policies..
Thu, Jul 11, 7:40 AM · Documentation, serviceops
jijiki moved T195392: Switch cronjobs on maintenance hosts to PHP7 from Next up to Doing on the serviceops board.
Thu, Jul 11, 7:38 AM · User-jijiki, cloud-services-team, Services (watching), serviceops, Core Platform Team Backlog (Watching / External), User-ArielGlenn, Operations

Wed, Jul 10

jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Wed, Jul 10, 7:15 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki claimed T226675: Undeploy electron service from WMF production.
Wed, Jul 10, 2:40 PM · Core Platform Team Backlog (Watching / External), Services (watching), serviceops
jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Wed, Jul 10, 1:54 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki awarded T227636: wikimediafoundation.org: ltr/rtl not properly handled in yellow box a Pterodactyl token.
Wed, Jul 10, 9:27 AM · I18n, RTL, wikimediafoundation.org

Tue, Jul 9

jijiki triaged T227592: Confd died on bast3002 as Normal priority.
Tue, Jul 9, 3:19 PM · Operations, serviceops
jijiki created T227592: Confd died on bast3002.
Tue, Jul 9, 3:18 PM · Operations, serviceops
jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Tue, Jul 9, 2:55 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki awarded T225059: Consider adding per-shard metrics to the prometheus mcrouter exporter a Cookie token.
Tue, Jul 9, 8:48 AM · Patch-For-Review, Performance-Team (Radar), observability, User-Elukey, Operations

Mon, Jul 8

jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Mon, Jul 8, 3:15 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki added a parent task for T221081: Replace nutcracker with mcrouter on thumbor* : T214275: Deprecate the usage of nutcracker for memcached.
Mon, Jul 8, 2:57 PM · serviceops, Operations, Thumbor
jijiki added a subtask for T214275: Deprecate the usage of nutcracker for memcached: T221081: Replace nutcracker with mcrouter on thumbor* .
Mon, Jul 8, 2:57 PM · Wikimedia-General-or-Unknown, serviceops, Performance-Team (Radar), User-Elukey, Operations
jijiki added a project to T214275: Deprecate the usage of nutcracker for memcached: serviceops.

@elukey I can do thumbor, not sure when yet.

Mon, Jul 8, 2:55 PM · Wikimedia-General-or-Unknown, serviceops, Performance-Team (Radar), User-Elukey, Operations
jijiki added a comment to T226675: Undeploy electron service from WMF production.

We are going to break this into steps:

Mon, Jul 8, 10:14 AM · Core Platform Team Backlog (Watching / External), Services (watching), serviceops
jijiki added a project to T226983: Page summary endpoint in RESTBase not updated since about June 27: Core Platform Team.
Mon, Jul 8, 7:38 AM · Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Workboards (Team 2), Operations, RESTBase-API, Page-Previews
jijiki added a project to T227265: mcrouter codfw proxies sometimes lead to TKOs: serviceops.
Mon, Jul 8, 7:37 AM · Performance-Team (Radar), User-Elukey, serviceops, Operations
jijiki added a project to T195364: Remove pear/mail packages from WMF MW app servers: serviceops.
Mon, Jul 8, 7:32 AM · serviceops, Patch-For-Review, Wikimedia-General-or-Unknown, Operations
jijiki updated subscribers of T227408: (OoW) restbase2009 lockup.
Mon, Jul 8, 5:35 AM · serviceops, ops-codfw, Operations
jijiki triaged T227408: (OoW) restbase2009 lockup as Normal priority.
Mon, Jul 8, 5:32 AM · serviceops, ops-codfw, Operations

Fri, Jul 5

jijiki closed T227076: Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021) as Resolved.

There are still messages like

Fri, Jul 5, 11:47 AM · serviceops, ops-eqiad, Operations
jijiki closed T227304: Reboot rdb* cluster as Resolved.
Fri, Jul 5, 11:21 AM · serviceops
jijiki moved T219127: SRE FY2019 Q4 goal: complete the transition to PHP7 from Backlog to Goal tasks on the serviceops board.
Fri, Jul 5, 10:18 AM · Operations, serviceops
jijiki moved T227306: Missing Documentation for Service Operations from Backlog to Goal tasks on the serviceops board.
Fri, Jul 5, 10:17 AM · Documentation, serviceops
jijiki triaged T227306: Missing Documentation for Service Operations as Normal priority.
Fri, Jul 5, 10:15 AM · Documentation, serviceops
jijiki created T227306: Missing Documentation for Service Operations.
Fri, Jul 5, 10:14 AM · Documentation, serviceops
jijiki triaged T227304: Reboot rdb* cluster as Normal priority.
Fri, Jul 5, 9:41 AM · serviceops
jijiki moved T227304: Reboot rdb* cluster from Backlog to Doing on the serviceops board.
Fri, Jul 5, 9:40 AM · serviceops
jijiki created T227304: Reboot rdb* cluster.
Fri, Jul 5, 9:34 AM · serviceops
jijiki moved T192457: Reallocate former image scalers from Next up to Backlog on the serviceops board.
Fri, Jul 5, 9:29 AM · serviceops, Operations
jijiki moved T195392: Switch cronjobs on maintenance hosts to PHP7 from Backlog to Next up on the serviceops board.
Fri, Jul 5, 9:28 AM · User-jijiki, cloud-services-team, Services (watching), serviceops, Core Platform Team Backlog (Watching / External), User-ArielGlenn, Operations
jijiki moved T215411: (OoW) thumbor1004 memory errors from Next up to Backlog on the serviceops board.
Fri, Jul 5, 9:27 AM · User-jijiki, Thumbor, ops-eqiad, serviceops, Operations

Thu, Jul 4

jijiki renamed T227076: Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021) from Degraded RAID on ms-be1021 to Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021).
Thu, Jul 4, 12:37 PM · serviceops, ops-eqiad, Operations
jijiki added a comment to T227076: Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021).

I will update its firwmare (like others in T141756) and see what happens

Thu, Jul 4, 12:36 PM · serviceops, ops-eqiad, Operations

Wed, Jul 3

jijiki moved T212828: SRE FY2019 Q3 goal: Ramp-up serving traffic to PHP 7 from Backlog to Goal tasks on the serviceops board.
Wed, Jul 3, 12:47 PM · User-Joe, serviceops, Operations
jijiki moved T213156: SRE FY2019 Q3:TEC6: First steps towards Canary Deployments from Backlog to Goal tasks on the serviceops board.
Wed, Jul 3, 12:45 PM · User-jijiki, Goal, Operations, serviceops, Scap
jijiki moved T37611: Remove port 29418 from cloning process from Doing to Backlog on the serviceops board.
Wed, Jul 3, 12:41 PM · serviceops, Developer-Advocacy, Operations, Gerrit
jijiki moved T226675: Undeploy electron service from WMF production from Next up to Doing on the serviceops board.
Wed, Jul 3, 12:41 PM · Core Platform Team Backlog (Watching / External), Services (watching), serviceops
jijiki moved T224538: Socket Errors on PHP7 from Doing to Next up on the serviceops board.
Wed, Jul 3, 12:41 PM · serviceops, Operations, PHP 7.2 support

Tue, Jul 2

jijiki closed T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed as Resolved.

All service restarts should be complete in a few hours, please reopen if there are any issues :)

Tue, Jul 2, 3:02 PM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2
jijiki updated subscribers of T227076: Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021).
Tue, Jul 2, 12:26 PM · serviceops, ops-eqiad, Operations
jijiki triaged T227076: Upgrade firmware on ms-be1021 (Was: Degraded RAID on ms-be1021) as High priority.
Tue, Jul 2, 11:22 AM · serviceops, ops-eqiad, Operations
jijiki added a comment to T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed.

@awight @jkroll should we rollout to all hosts?

Tue, Jul 2, 7:15 AM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2
jijiki claimed T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed.
Tue, Jul 2, 7:13 AM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2

Mon, Jul 1

jijiki added projects to T226948: Degraded RAID on mw2250: serviceops, User-jijiki.
Mon, Jul 1, 9:22 PM · User-jijiki, serviceops, Operations, ops-codfw

Fri, Jun 28

jijiki added a comment to T224491: PHP 7 corruption during deployment (was: PHP 7 fatals on mw1262).
Fri, Jun 28, 3:58 AM · User-jijiki, serviceops, PHP 7.2 support, Performance-Team (Radar), Operations, Wikimedia-production-error

Thu, Jun 27

jijiki merged T223825: Degraded RAID on restbase-dev1006 into T224260: restbase-dev1006 has a broken disk.
Thu, Jun 27, 3:09 PM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Operations, DC-Ops, ops-eqiad
jijiki merged task T223825: Degraded RAID on restbase-dev1006 into T224260: restbase-dev1006 has a broken disk.
Thu, Jun 27, 3:09 PM · ops-eqiad, Operations
jijiki added a comment to T224857: Enhance MediaWiki deployments for support of php7.x.
Thu, Jun 27, 12:04 PM · Release-Engineering-Team (Deployment services), Release-Engineering-Team-TODO, Patch-For-Review, User-jijiki, PHP 7.2 support, Scap, serviceops
jijiki added a comment to T226373: Swift object servers become briefly unresponsive on a regular basis.

@Joe I will start a more thorough investigation the following days, we'll see what will come up

Thu, Jun 27, 12:04 PM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations
jijiki added a comment to T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed.

@awight I will rollout the new version to production today

Thu, Jun 27, 11:38 AM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2
jijiki moved T226373: Swift object servers become briefly unresponsive on a regular basis from Doing to Backlog on the serviceops board.
Thu, Jun 27, 11:29 AM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations
jijiki added a project to T226373: Swift object servers become briefly unresponsive on a regular basis: User-jijiki.
Thu, Jun 27, 11:29 AM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations

Wed, Jun 26

jijiki moved T226373: Swift object servers become briefly unresponsive on a regular basis from Backlog to Doing on the serviceops board.
Wed, Jun 26, 6:45 AM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations
jijiki added a project to T226373: Swift object servers become briefly unresponsive on a regular basis: serviceops.
Wed, Jun 26, 6:45 AM · User-jijiki, serviceops, Patch-For-Review, media-storage, Operations
jijiki lowered the priority of T37611: Remove port 29418 from cloning process from Normal to Low.
Wed, Jun 26, 5:49 AM · serviceops, Developer-Advocacy, Operations, Gerrit

Tue, Jun 25

jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Tue, Jun 25, 7:38 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki updated the task description for T219148: Use PHP7 to run all async jobs.
Tue, Jun 25, 5:35 PM · Patch-For-Review, Core Platform Team Backlog (Watching / External), User-jijiki, Services (watching), Operations, serviceops
jijiki updated the task description for T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed.
Tue, Jun 25, 3:00 PM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2
jijiki lowered the priority of T223391: Deploy Wikidiff2 version 1.8.2 with the timeout issue fixed from High to Normal.

@thiemowmde @WMDE-Fisch I have installed php-wikidiff2_1.8.2-1~wmf1_amd64 on deployment-mediawiki-09 and deployment-mediawiki-07 but I have not restarted php72-fpm there. You can restart it when you are ready to test it. Let me know how it went so to proceed with the production upgrade:)

Tue, Jun 25, 2:58 PM · WMDE-QWERTY-Sprint-2019-06-26, User-jijiki, WMDE-QWERTY-Sprint-2019-06-12, WMDE-QWERTY-Sprint-2019-05-29, serviceops, Operations, WMDE-QWERTY-Sprint-2019-05-15, WMDE-QWERTY-Team, wikidiff2
jijiki closed T224915: Deploy scap 3.10.0-1 as Resolved.
Tue, Jun 25, 1:45 PM · Release-Engineering-Team (Deployment services), User-jijiki, Release-Engineering-Team-TODO, serviceops, Scap
jijiki closed T224915: Deploy scap 3.10.0-1, a subtask of T222539: Scap deployments are not purging MessageBlobStore (was: Stale localized messages), as Resolved.
Tue, Jun 25, 1:45 PM · Release-Engineering-Team-TODO (201907), MW-1.34-notes (1.34.0-wmf.7; 2019-05-28), Performance-Team (Radar), Patch-For-Review, Scap, Regression, MediaWiki-ResourceLoader
jijiki added a comment to T224260: restbase-dev1006 has a broken disk.

@RobH @Cmjohnson I had an issue today again running cumin to the fleet because restbase-dev1006 was stalling due to disk errors :(

Tue, Jun 25, 1:19 PM · Cassandra, RESTBase, Core Platform Team (Security, stability, performance and scalability (TEC1)), Core Platform Team Backlog (Watching / External), Services (watching), Operations, DC-Ops, ops-eqiad