Page MenuHomePhabricator

conf200[7-9] implementation tracking
Open, In Progress, MediumPublic

Description

conf200[7-9] implementation tracking

This task is to track the service implementation of serviceops host(s) conf200[7-9]

Once the linked racking task has been resolved, this task can be implemented.

This sub-task creation/update is per the request of ServiceOps; this task is assigned at creation to the 'Sub-team Technical Contact' provided in the initial ordering task.

Event Timeline

Raine triaged this task as Medium priority.Mar 4 2026, 9:10 PM
Raine moved this task from Inbox to Needs Info / Blocked on the ServiceOps board.
Scott_French changed the task status from Open to Stalled.Mar 12 2026, 5:05 PM

@Scott_French As discussed on IRC: To derisk the Zookeeper part of the update I've build a forward port of 3.4.13 from Bullseye for trixie. It's a tricky forward port given four years of toolchain changes, but with some blunt choices I made it work:

  • The Debian Zookeeper package includes Python bindings. The ones from 3.4 were compatible with Python 3.9, but with Trixie's Python 3.13 they are not compatible. Fortunately we don't use the Python module anywhere in production, so I patched it out of the Debian package build
  • The Debian Zookeeper package also includes some code from https://github.com/apache/zookeeper/tree/master/zookeeper-contrib. Some of that code is written in C++ and while it builds with GCC 10 from Bullseye, GCC 14 from Trixie is stricter and we'd need to cherrypick various compat changes from more recent upstream versions to make it build. But since we don't use or need any of those tools I simply patched them out.

Next I would import these to a separate repository component to be applied on the Trixie conf* hosts, maybe something like component/zookeeper34 ?

That's amazing - thank you very much, @MoritzMuehlenhoff! Yes, if you could import those into a dedicated component (component/zookeeper34 sounds good), that would be perfect.

I plan to write up the proposed migration procedure, and how this will feature in it, shortly (ideally later today).

MLechvien-WMF changed the task status from Stalled to In Progress.Jun 22 2026, 12:21 PM
MLechvien-WMF moved this task from Needs Info / Blocked to In Progress on the ServiceOps board.
MLechvien-WMF subscribed.

@Scott_French FYI parent task is done and this is now un-stalled

Also can you create the decommissioning tasks? Thanks

Indeed, thanks! And yes, will do when we get to that point (decom tasks for conf200[456]).

Change #1309257 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] zookeeper: Support installation from component/zookeeper34

https://gerrit.wikimedia.org/r/1309257

Change #1309260 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: Use zookeeper34 forward-port component in codfw

https://gerrit.wikimedia.org/r/1309260

Change #1309303 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/software/etcd-mirror@master] Consolidate and modernize test dependencies and entrypoint

https://gerrit.wikimedia.org/r/1309303

Change #1309315 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] P:etcd::v3: Add support for explicitly enabling the v2 API

https://gerrit.wikimedia.org/r/1309315

Change #1309317 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: Explicitly enable the v2 API in codfw

https://gerrit.wikimedia.org/r/1309317

Change #1309303 merged by jenkins-bot:

[operations/software/etcd-mirror@master] Consolidate and modernize test dependencies and entrypoint

https://gerrit.wikimedia.org/r/1309303

Change #1309718 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/software/etcd-mirror@master] Bump etcdmirror package version: 0.0.12

https://gerrit.wikimedia.org/r/1309718

Change #1309719 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/software/etcd-mirror@master] Release etcd-mirror 0.0.12

https://gerrit.wikimedia.org/r/1309719

Change #1309718 merged by jenkins-bot:

[operations/software/etcd-mirror@master] Bump etcdmirror package version: 0.0.12

https://gerrit.wikimedia.org/r/1309718

Change #1309719 merged by jenkins-bot:

[operations/software/etcd-mirror@master] Release etcd-mirror 0.0.12

https://gerrit.wikimedia.org/r/1309719

Cross-posting:

I've built etcd-mirror 0.0.12 packages for bullseye, bookworm, and trixie, as part of the work in T418915: conf200[7-9] implementation tracking. I've also tested all three versions in a simple docker compose testbed (with various permutations of up- and downstream etcd versions).

... which is to say, at least that aspect appears to be trixie-ready.

Change #1309315 merged by Scott French:

[operations/puppet@production] P:etcd::v3: Add support for explicitly enabling the v2 API

https://gerrit.wikimedia.org/r/1309315

Change #1309257 merged by Scott French:

[operations/puppet@production] zookeeper: Support installation from component/zookeeper34

https://gerrit.wikimedia.org/r/1309257

Change #1309260 merged by Scott French:

[operations/puppet@production] hieradata: Use component/zookeeper34 on conf* hosts (codfw)

https://gerrit.wikimedia.org/r/1309260

Change #1314015 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: Explicitly enable the v2 API on conf2004

https://gerrit.wikimedia.org/r/1314015

Change #1314015 merged by Scott French:

[operations/puppet@production] hieradata: Explicitly enable the v2 API on conf2004

https://gerrit.wikimedia.org/r/1314015

Change #1309317 merged by Scott French:

[operations/puppet@production] hieradata: Enable the v2 API and set cluster_bootstrap false in codfw

https://gerrit.wikimedia.org/r/1309317

Change #1321106 had a related patch set uploaded (by Scott French; author: Scott French):

[operations/puppet@production] hieradata: Use component/zookeeper34 on all configcluster hosts

https://gerrit.wikimedia.org/r/1321106

Change #1321106 merged by Scott French:

[operations/puppet@production] hieradata: Use component/zookeeper34 on all configcluster hosts

https://gerrit.wikimedia.org/r/1321106