The completion suggester uses a new threadpool equals to the number of proc (32 in codfw). This value needs to be changed because we could run 32+49 queries.
A value of 10 seems to work well on codfw but maybe we should decrease the search thread pool from 49 to 39.
It's even harder in eqiad since the number of proc is not the same on all machines.
This is the purpose of this ticket: find the best strategy for thread pools.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Deskana | T121616 EPIC: Resolve technical or product blockers to enable us to do a more full rollout of the completion suggester | |||
| Resolved | • Deskana | T125669 Completion suggester: fine-tune thread pools |
Bumping up priority since this relates to the rollout of the completion suggester (T121616), which is a priority this quarter.
Is this really blocking T121616? If so, it needs to be resolved soon, because the timeline for full production release has been set.
This has to happen as part of the march 16th rollout, it's hard to predict what these need to be before we start putting real load on the cluster.
I don't think it's related but I see short but huge spikes in tp99... I had a quick look but found nothing obvious, I created T130719 to track this problem.