Certain jobs are related to videoscalers and must run on videoscalers hosts exclusively, so we need an LVS endpoint configured for them in order to submit the jobs from ChangeProp
Description
Description
Details
Details
Customize query in gerrit
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Pchelolo | T157088 [EPIC] Develop a JobQueue backend based on EventBus | |||
| Resolved | • Pchelolo | T190327 FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus | |||
| Resolved | • Pchelolo | T188947 Create an LVS endpoint for jobrunners on videoscalers |
Event Timeline
Comment Actions
I'd take the chance we have to do this to do as follows:
- Add mediawiki::multimedia to the jobrunners
- Add a second LVS IP, to be served from the same cluster, to use for videoscaling. This will guarantee we evenly distribute videoscaling jobs across all the backends
- Fold the old videoscalers in the new cluster, for added capacity
the differences between the two clusters are small enough (basically, some apache config we want to remove / unify anyways) that we really don't want to keep up with the cost of separation between the two.
Comment Actions
These jobs are not high-traffic, so consolidating the job runners and spreading the load all over them sounds like a good approach to me, +1.
Comment Actions
Add a second LVS IP, to be served from the same cluster, to use for videoscaling. This will guarantee we evenly distribute videoscaling jobs across all the backends
Do we even need the second LVS in case it will be the same exact cluster?
Comment Actions
Yes, so that scaling and transcoding jobs are balanced across the cluster between themselves rather than being in the same pot as with the other (comparatively insignificantly CPU-intense) jobs.
Comment Actions
Change 437210 had a related patch set uploaded (by Giuseppe Lavagetto; owner: Giuseppe Lavagetto):
[operations/dns@master] Add entries for the videoscaler VIP
Comment Actions
Change 437223 had a related patch set uploaded (by Giuseppe Lavagetto; owner: Giuseppe Lavagetto):
[operations/puppet@production] jobrunner_tls: generalize to support videoscalers as well
Comment Actions
Change 437224 had a related patch set uploaded (by Giuseppe Lavagetto; owner: Giuseppe Lavagetto):
[operations/puppet@production] role::mediawiki::videoscaler: add TLS termination
Comment Actions
Change 437225 had a related patch set uploaded (by Giuseppe Lavagetto; owner: Giuseppe Lavagetto):
[operations/puppet@production] conftool-data: Add missing data for videoscalers
Comment Actions
Change 437226 had a related patch set uploaded (by Giuseppe Lavagetto; owner: Giuseppe Lavagetto):
[operations/puppet@production] lvs::configuration: Add configuration for the videoscaler service
Comment Actions
Change 437223 merged by Giuseppe Lavagetto:
[operations/puppet@production] jobrunner_tls: generalize to support videoscalers as well
Comment Actions
Change 437224 merged by Giuseppe Lavagetto:
[operations/puppet@production] role::mediawiki::videoscaler: add TLS termination
Comment Actions
Change 437225 merged by Giuseppe Lavagetto:
[operations/puppet@production] conftool-data: Add missing data for videoscalers
Comment Actions
Change 437210 merged by Giuseppe Lavagetto:
[operations/dns@master] Add entries for the videoscaler VIP
Comment Actions
Change 437226 merged by Giuseppe Lavagetto:
[operations/puppet@production] lvs::configuration: Add configuration for the videoscaler service