Page MenuHomePhabricator

Re-adjust cirrusSearchLinksUpdate vs cirrusSearchLinksUpdatePrioritized concurrency
Closed, ResolvedPublic

Description

A recent fix in CirrusSearch caused the cirrusSearchLinksUpdate jobs to be routed to the prio/non-prio topics correctly.
Prior to https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CirrusSearch/+/535869 all jobs were routed to the prioritized topic cirrusSearchLinksUpdate.
Now the cirrusSearchLinksUpdatePrioritized should only be populated for "root" LinksUpdate jobs. Other changes due to template propagation should be scheduled to the cirrusSearchLinksUpdate, the effect is visible on the number of received messages on both of these topics.

We should perhaps re-adjust the concurrency configuration of these topics in changeprop.

Event Timeline

dcausse created this task.Mon, Sep 23, 8:43 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMon, Sep 23, 8:43 AM
dcausse renamed this task from Re-adjust cirrusSearchLinksUpdate vs cirrusSearchLinksUpdate to Re-adjust cirrusSearchLinksUpdate vs cirrusSearchLinksUpdatePrioritized concurrency.Mon, Sep 23, 8:53 AM
dcausse updated the task description. (Show Details)
dcausse moved this task from in progress to Waiting on the Discovery-Search (Current work) board.

Change 538835 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/services/change-propagation/jobqueue-deploy@master] [cirrus] increase cirrusSearchLinksUpdate concurrency

https://gerrit.wikimedia.org/r/538835

Change 538835 merged by Mobrovac:
[mediawiki/services/change-propagation/jobqueue-deploy@master] [cirrus] increase cirrusSearchLinksUpdate concurrency

https://gerrit.wikimedia.org/r/538835

Change 538854 had a related patch set uploaded (by Mobrovac; owner: Mobrovac):
[mediawiki/services/change-propagation/jobqueue-deploy@master] CirrusSearchLinksUpdate: Bump concurrency temporarily to 300

https://gerrit.wikimedia.org/r/538854

mobrovac triaged this task as High priority.

Change 538854 merged by Mobrovac:
[mediawiki/services/change-propagation/jobqueue-deploy@master] CirrusSearchLinksUpdate: Bump concurrency temporarily to 300

https://gerrit.wikimedia.org/r/538854

Mentioned in SAL (#wikimedia-operations) [2019-09-24T10:55:05Z] <mobrovac@deploy1001> Started deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584

Mentioned in SAL (#wikimedia-operations) [2019-09-24T10:56:04Z] <mobrovac@deploy1001> Finished deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 (duration: 01m 00s)

Change 538872 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] temp disable sanity check

https://gerrit.wikimedia.org/r/538872

Change 538872 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] temp disable sanity check

https://gerrit.wikimedia.org/r/538872

Mentioned in SAL (#wikimedia-operations) [2019-09-24T12:20:30Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T233584 [cirrus] temp disable sanity check (duration: 00m 55s)

Mentioned in SAL (#wikimedia-operations) [2019-09-25T07:51:20Z] <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T233584 revert: [cirrus] temp disable sanity check (duration: 01m 05s)

mobrovac closed this task as Resolved.Mon, Oct 7, 11:15 AM
mobrovac edited projects, added Services (done); removed Services (doing).

The jobs are stable even with the higher concurrency, so I'd be inclined of keeping the current level. Resolving.