Page MenuHomePhabricator

Acquire old production API servers for use in CI
Closed, DeclinedPublic


Let's use this ticket for tracking this work.

Thanks to Mark for offering up the old API boxes for this; it'll be really useful.

Can someone from Ops let me/this ticket know what the next steps are here?

Event Timeline

greg raised the priority of this task from to Medium.
greg updated the task description. (Show Details)
greg changed Security from none to None.
greg added subscribers: greg, hashar, Krinkle and 3 others.

+Coren I talked with him about CI labs during the summer.

That is following the meeting we had for the RFC "Extensions continuous integration" (T1350). With more and more tests being run we need more CPU processing, and the more we have the more tests we can add to our repositories.

For the context, I want to move most tests to run on labs instances since it is easy to scale. We will eventually spawn a new instance per job build and destroy it after.

Possibly, we could add a share of the old apps server to the wmflabs infrastructure and dedicate them to the CI project. Apparently OpenStack has support for that. Then we can use the OpenStack API to maintain a pool of labs instance on that hardware to save up the initialization time and then have them consumed by Jenkins jobs.

Yeah. CI isn't currently in need of more bare-metal nodes as Jenkins slaves (like gallium and lanthanum are at the moment). These resources would be better spent on our cluster of labs instances.

We might have a use for them to set some CI supporting servers straight inside the labs infrastructure. That would host the Zuul mergers which provides the patch sets and mostprobably nodepool which needs to interact with the OpenStack API on some virt* machine.

That would mean most would be moved out of production as labs bare metal servers.

Will make a proposal along that way with T86171: Design the Jenkins isolation architecture

hashar claimed this task.

We are using labs infrastructure for now. There is no plan to reuse the old mw apps server.