Page MenuHomePhabricator
Create Task
Maniphest T144602

Depool and repool SCB services during deploys
Closed, ResolvedPublic0 Estimated Story Points
Actions

Assigned To
• mobrovac
Authored By
• mobrovac
Sep 2 2016, 2:42 PM
Tags
Referenced Files
None
Subscribers
Aklapper
Amire80
gerritbot
greg
• mobrovac
Stashbot
Tokens
"Barnstar" token, awarded by greg.

Description

We can now depool servers when we deploy to them and repool them back once the service has been restarted. We should tell Scap3 to do it for each SCB service so as to keep the amount of failed requests due to deploys to a minimum.

Details

SubjectRepoBranchLines +/-
Scap: Depool and repool EventStreams during restartsmediawiki/services/eventstreams/deploymaster+14 -0
Scap: Depool and repool Trending Edits during restartsmediawiki/services/trending-edits/deploymaster+12 -0
Scap: Depool and repool MobileApps during restartsmediawiki/services/mobileapps/deploymaster+11 -0
Scap: Depool and repool PDFRender during restartsmediawiki/services/electron-render/deploymaster+14 -0
Scap: Depool and repool Graphoid during restartsmediawiki/services/graphoid/deploymaster+18 -0
Scap: Depool and repool CXServer during restartsmediawiki/services/cxserver/deploymaster+12 -0
Scap: Depool and repool Citoid during restartsmediawiki/services/citoid/deploymaster+13 -0
Scap: Depool and repool Mathoid during restartsmediawiki/services/mathoid/deploymaster+13 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

• mobrovac created this task.Sep 2 2016, 2:42 PM
Restricted Application added a project: VisualEditor. · View Herald TranscriptSep 2 2016, 2:42 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
• mobrovac triaged this task as Medium priority.Sep 2 2016, 2:42 PM
Jdforrester-WMF moved this task from To Triage to External and Administrivia on the VisualEditor board.Sep 2 2016, 5:16 PM
• bearND moved this task from Incoming to Tracking on the Mobile-Content-Service board.Sep 6 2016, 7:35 PM
• mobrovac added a subtask: T145518: Depool / repool scripts execute successfully even when the host has not been (r|d)epooled.Sep 13 2016, 5:59 PM
Mvolz moved this task from Backlog to Production on the Citoid board.Oct 10 2016, 2:23 PM
Restricted Application added a project: ContentTranslation. · View Herald TranscriptOct 10 2016, 2:23 PM
Amire80 added a project: ContentTranslation-Deployments.Oct 10 2016, 4:31 PM
Amire80 subscribed.

Mmmm, this is super-internal and technical, but it's on the ContentTranslation board, so I have to triage it :)

When is this supposed to happen and who will do it?

Joe closed subtask T145518: Depool / repool scripts execute successfully even when the host has not been (r|d)epooled as Resolved.Oct 14 2016, 9:41 AM
Amire80 moved this task from Needs Triage to Upstream/Other teams on the ContentTranslation board.Oct 31 2016, 1:52 PM
• demon moved this task from Needs triage to Services improvements on the Scap board.Dec 8 2016, 1:57 AM
• mobrovac edited projects, added Services (next); removed Services.Dec 16 2016, 9:57 PM
gerritbot subscribed.Dec 28 2016, 1:09 PM

Change 329476 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool Mathoid during restarts

https://gerrit.wikimedia.org/r/329476

gerritbot added a project: Patch-For-Review.Dec 28 2016, 1:09 PM
• mobrovac edited projects, added Electron-PDFs, Services (doing); removed Services (next).Dec 28 2016, 1:09 PM
gerritbot added a comment.Dec 28 2016, 1:10 PM

Change 329476 merged by Mobrovac:
Scap: Depool and repool Mathoid during restarts

https://gerrit.wikimedia.org/r/329476

Stashbot subscribed.Dec 28 2016, 1:19 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:19:08Z] <mobrovac@tin> Starting deploy [mathoid/deploy@79fdd56]: Add depooling and repooling to Mathoid T144602

Stashbot added a comment.Dec 28 2016, 1:21 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:21:39Z] <mobrovac@tin> Finished deploy [mathoid/deploy@79fdd56]: Add depooling and repooling to Mathoid T144602 (duration: 02m 31s)

gerritbot added a comment.Dec 28 2016, 1:27 PM

Change 329477 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool Citoid during restarts

https://gerrit.wikimedia.org/r/329477

gerritbot added a comment.Dec 28 2016, 1:27 PM

Change 329477 merged by Mobrovac:
Scap: Depool and repool Citoid during restarts

https://gerrit.wikimedia.org/r/329477

Stashbot added a comment.Dec 28 2016, 1:31 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:31:02Z] <mobrovac@tin> Starting deploy [citoid/deploy@da96f4b]: Add depooling and repooling to Citoid T144602

Stashbot added a comment.Dec 28 2016, 1:33 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:33:01Z] <mobrovac@tin> Finished deploy [citoid/deploy@da96f4b]: Add depooling and repooling to Citoid T144602 (duration: 01m 59s)

gerritbot added a comment.Dec 28 2016, 1:38 PM

Change 329479 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool CXServer during restarts

https://gerrit.wikimedia.org/r/329479

gerritbot added a comment.Dec 28 2016, 1:38 PM

Change 329479 merged by Mobrovac:
Scap: Depool and repool CXServer during restarts

https://gerrit.wikimedia.org/r/329479

Stashbot added a comment.Dec 28 2016, 1:41 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:41:18Z] <mobrovac@tin> Starting deploy [cxserver/deploy@0279029]: Add depooling and repooling to CXServer T144602

Stashbot added a comment.Dec 28 2016, 1:44 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:44:41Z] <mobrovac@tin> Finished deploy [cxserver/deploy@0279029]: Add depooling and repooling to CXServer T144602 (duration: 03m 22s)

gerritbot added a comment.Dec 28 2016, 1:47 PM

Change 329480 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool Graphoid during restarts

https://gerrit.wikimedia.org/r/329480

gerritbot added a comment.Dec 28 2016, 1:47 PM

Change 329480 merged by Mobrovac:
Scap: Depool and repool Graphoid during restarts

https://gerrit.wikimedia.org/r/329480

Stashbot added a comment.Dec 28 2016, 1:49 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:49:36Z] <mobrovac@tin> Starting deploy [graphoid/deploy@151f26c]: Add depooling and repooling to Graphoid T144602

Stashbot added a comment.Dec 28 2016, 1:51 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:51:14Z] <mobrovac@tin> Finished deploy [graphoid/deploy@151f26c]: Add depooling and repooling to Graphoid T144602 (duration: 01m 37s)

gerritbot added a comment.Dec 28 2016, 1:57 PM

Change 329481 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool PDFRender during restarts

https://gerrit.wikimedia.org/r/329481

gerritbot added a comment.Dec 28 2016, 1:58 PM

Change 329481 merged by Mobrovac:
Scap: Depool and repool PDFRender during restarts

https://gerrit.wikimedia.org/r/329481

Stashbot added a comment.Dec 28 2016, 1:59 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T13:59:05Z] <mobrovac@tin> Starting deploy [electron-render/deploy@b2a820e]: Add depooling and repooling to PDFRender T144602

Stashbot added a comment.Dec 28 2016, 2:00 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T14:00:31Z] <mobrovac@tin> Finished deploy [electron-render/deploy@b2a820e]: Add depooling and repooling to PDFRender T144602 (duration: 01m 26s)

gerritbot added a comment.Dec 28 2016, 2:04 PM

Change 329482 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool MobileApps during restarts

https://gerrit.wikimedia.org/r/329482

gerritbot added a comment.Dec 28 2016, 2:04 PM

Change 329482 merged by Mobrovac:
Scap: Depool and repool MobileApps during restarts

https://gerrit.wikimedia.org/r/329482

Stashbot added a comment.Dec 28 2016, 2:05 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T14:05:08Z] <mobrovac@tin> Starting deploy [mobileapps/deploy@ae22656]: Add depooling and repooling to MCS T144602

Stashbot added a comment.Dec 28 2016, 2:07 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T14:07:41Z] <mobrovac@tin> Finished deploy [mobileapps/deploy@ae22656]: Add depooling and repooling to MCS T144602 (duration: 02m 34s)

• mobrovac added a project: Trending-Service.Dec 28 2016, 2:08 PM
gerritbot added a comment.Dec 28 2016, 2:08 PM

Change 329484 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool Trending Edits during restarts

https://gerrit.wikimedia.org/r/329484

gerritbot added a comment.Dec 28 2016, 2:09 PM

Change 329484 merged by Mobrovac:
Scap: Depool and repool Trending Edits during restarts

https://gerrit.wikimedia.org/r/329484

Stashbot added a comment.Dec 28 2016, 2:11 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T14:11:09Z] <mobrovac@tin> Starting deploy [trending-edits/deploy@c5d239b]: Add depooling and repooling to Trending Edits T144602

Stashbot added a comment.Dec 28 2016, 2:12 PM

Mentioned in SAL (#wikimedia-operations) [2016-12-28T14:12:30Z] <mobrovac@tin> Finished deploy [trending-edits/deploy@c5d239b]: Add depooling and repooling to Trending Edits T144602 (duration: 01m 21s)

gerritbot added a comment.Dec 28 2016, 2:23 PM

Change 329488 had a related patch set uploaded (by Mobrovac):
Scap: Depool and repool EventStreams during restarts

https://gerrit.wikimedia.org/r/329488

gerritbot added a comment.Dec 28 2016, 2:24 PM

Change 329488 merged by Mobrovac:
Scap: Depool and repool EventStreams during restarts

https://gerrit.wikimedia.org/r/329488

• mobrovac closed this task as Resolved.Dec 28 2016, 2:25 PM
• mobrovac edited projects, added Services (done); removed Services (doing), Patch-For-Review.

Completed. All of the SCB services are now automatically depooled / repooled during deployments. Resolving.

• mobrovac mentioned this in rMSTEDc5d239b53b3d: Scap: Depool and repool Trending Edits during restarts.Dec 28 2016, 2:38 PM
greg awarded a token.Jan 3 2017, 9:19 PM
greg subscribed.

\o/

Jdforrester-WMF set the point value for this task to 0.Jan 10 2017, 11:25 PM
Aklapper added a project: Math.Jun 24 2020, 5:53 AM
Restricted Application added projects: User-Ryasmeen, Product-Infrastructure-Team-Backlog-Deprecated. · View Herald TranscriptJun 24 2020, 5:53 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL