I tried to re-create deployment-kafka-logging01 in deployment-prep with Debian Trixie and Kafka 3.7 to test the new versions, but for some reason puppet doesn't work. I noticed that puppet is not installed correctly, since we don't support 8:
elukey@deployment-kafka-logging01:~$ dpkg -l | grep puppet ii puppet-agent 8.10.0-5 all configuration management system, agent
At the moment the Beta logs are down, I'll prioritize this on Monday. Sorry for the inconvenience!
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | elukey | T420034 deployment-kafka-logging01 is down for maintenance because Trixie is not yet well supported | |||
| Resolved | elukey | T420083 Create Java 21 security config in puppet |
Change #1251539 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:kafka::broker::monitoring: Fix legacy facts
Change #1251540 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] confluent: kafka::broker: Fix legacy facts
elukey@deployment-kafka-logging01:~$ apt-cache policy puppet-agent
puppet-agent:
Installed: 8.10.0-5
Candidate: 7.23.0-1+wmf13u1
Version table:
*** 8.10.0-5 500
500 http://mirrors.wikimedia.org/debian trixie/main amd64 Packages
100 /var/lib/dpkg/status
7.23.0-1+wmf13u1 1002
1001 http://apt.wikimedia.org/wikimedia trixie-wikimedia/component/puppet7 amd64 PackagesI just forced an apt-get install puppet-agent and the right one was installed, so it may be a race condition? Anyway, now the issue is:
Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, Could not find template 'java/java-21.security.erb' (file: /srv/puppet_code/environments/production/modules/java/manifests/package.pp, line: 50, column: 24) (file: /srv/puppet_code/environments/production/modules/java/manifests/init.pp, line: 21) on node deployment-kafka-logging01.deployment-prep.eqiad1.wikimedia.cloud
That makes sense - we don't have a java-21 security config yet in puppet. I am going to create a task to do it, I'll chat with Moritz about it as well.
Kafka 3.7 is running on deployment-kafka-logging01 with Debian Trixie, first one of its kind!
@colewhite I see logstash consumer groups connecting, when you have a moment could you verify if everything works for beta logs?
Change #1251539 merged by Elukey:
[operations/puppet@production] P:kafka::broker::monitoring: Fix legacy facts
Change #1251540 merged by Elukey:
[operations/puppet@production] confluent: kafka::broker: Fix legacy facts