Page MenuHomePhabricator

scap service restarts for WDQS are inconsistent
Closed, ResolvedPublic

Description

As a user, I don't want a WDQS deployment to accidentally break things.

Right now, when WDQS is deployed, only service wdqs-blazegraph is restarted. This is not very useful, because:

  • If we deploy updater, we need to restart wdqs-updater
  • If we deploy Blazegraph, we need to restart wdqs-blazegraph and wdqs-categories
  • If we only deploy GUI, we don't really need to restart either

However, since scap seems to use new checkout for each deploy, maybe in fact we need to restart all three every time, since we don't want them running off old files. Not sure yet which model would make the most sense - if we restart both, they need to be restarted one after another, with delay, otherwise Updater may fail.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
dcausse subscribed.

With the graph split deploying wdqs is even harder since you have to run cuming to apply a restart on wider set of nodes possibly different roles, ideally a deployer should simply have to run scap deploy to fully deploy & restart:

  • wdqs-blazegraph
  • wdqs-updater
  • wdqs-categories

Change #1133918 had a related patch set uploaded (by DCausse; author: DCausse):

[wikidata/query/deploy@master] Handle all possibly services relying on these artifacts

https://gerrit.wikimedia.org/r/1133918

Change #1133918 merged by DCausse:

[wikidata/query/deploy@master] Handle all possibly services relying on these artifacts

https://gerrit.wikimedia.org/r/1133918

Mentioned in SAL (#wikimedia-operations) [2025-04-15T08:09:05Z] <dcausse@deploy1003> Started deploy [wdqs/wdqs@4186ae7]: test deploy new scap config to wdqs2025.codfw.wmnet (T221709)

Mentioned in SAL (#wikimedia-operations) [2025-04-15T08:09:23Z] <dcausse@deploy1003> Finished deploy [wdqs/wdqs@4186ae7]: test deploy new scap config to wdqs2025.codfw.wmnet (T221709) (duration: 00m 18s)

Mentioned in SAL (#wikimedia-operations) [2025-04-15T08:51:11Z] <dcausse@deploy1003> Started deploy [wdqs/wdqs@4186ae7] (wcqs): test deploy new scap config to wcqs2001.codfw.wmnet (T221709)

Mentioned in SAL (#wikimedia-operations) [2025-04-15T08:51:31Z] <dcausse@deploy1003> Finished deploy [wdqs/wdqs@4186ae7] (wcqs): test deploy new scap config to wcqs2001.codfw.wmnet (T221709) (duration: 00m 20s)

tested wdqs & wcqs deploys and all the expected services got restarted successfully.