This is the tracking task to collect all the efforts needed to establish a good upgrade procedure for all the WMF Kafka clusters. It should also be meant to collect the updates coming from the Kafka upgrade working group within SRE.
Upgrade document: https://docs.google.com/document/d/1eHqkgKZitERH3M4NkJPA3qW3qWqF4haIkyMbZLJtATw/edit?tab=t.0
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T416669 Upgrade Kafka to version 3.x | |||
| Resolved | elukey | T416670 Package Confluent Platform 7.5.x / Kafka 3.5 | |||
| Declined | None | T416674 Test and upgrade Kafka clusters to Openjdk 17 | |||
| Resolved | None | T417031 Review the most critical/popular Kafka clients before the Kafka upgrade | |||
| Resolved | None | T417034 Add some kafka clients to the Kafka test cluster | |||
| Resolved | elukey | T417035 Create a cookbook to execute Kafka rolling upgrades | |||
| Resolved | brouberol | T417407 Evacuate all kafka-mirrormaker instances to Kubernetes | |||
| Open | jasmine_ | T419216 Upgrade kafka-main to Kafka 3.7 | |||
| Resolved | herron | T423723 Upgrade kafka-logging to version 3.7 | |||
| Resolved | brouberol | T424527 Upgrade kafka-jumbo to kafka 3.7 | |||
| Open | elukey | T425528 Rework ACLs on Kafka 3.x clusters | |||
| Open | None | T425621 Move Kafka mirror monitors and alerts to the alerts repo | |||
| Open | None | T425747 Update roll-restart-reboot-brokers.py to display broker id and FQDN of the broker |