While testing stuff in beta, I tried a user flow that enqueues a job, but that job never got enqueued. I SSH'd to the kafka hosts to see what's going on, and it looks like kafka-topics is straight away broken:
daimona@deployment-kafka-main-5:~$ kafka topics --list kafka-topics --zookeeper deployment-zookeeper-3.deployment-prep.eqiad1.wikimedia.cloud/kafka/main-deployment-prep --list zookeeper is not a recognized option joptsimple.UnrecognizedOptionException: zookeeper is not a recognized option at joptsimple.OptionException.unrecognizedOption(OptionException.java:108) at joptsimple.OptionParser.handleLongOptionToken(OptionParser.java:510) at joptsimple.OptionParserState$2.handleArgument(OptionParserState.java:56) at joptsimple.OptionParser.parse(OptionParser.java:396) at org.apache.kafka.tools.TopicCommand$TopicCommandOptions.<init>(TopicCommand.java:802) at org.apache.kafka.tools.TopicCommand.execute(TopicCommand.java:97) at org.apache.kafka.tools.TopicCommand.mainNoExit(TopicCommand.java:87) at org.apache.kafka.tools.TopicCommand.main(TopicCommand.java:82)
(and same result in deployment-kafka-main-6, FWIW).
I then tried to enqueue a job via eval.php (as in T387631#10647693), and that at least seems to work.
I don't know if the kafka-topics error is also why jobs seemingly aren't enqueued, but I'd rather hold off any additional testing until that issue is sorted out.
(Besides, it would be nice if these things were caught earlier and by some tool that isn't me, as this is at least the third time I'm left puzzled by jobs not working in beta, after T387631 and T401002).