On IRC you mentioned a github link that seemed promising.

https://github.com/rubys/venus/issues/37 points to https://github.com/feedreader/pluto which is written in Ruby and still seems to be actively maintained.

Also: https://grep.be/blog//en/computer/Planet_Grep_now_running_PtLink/

Change 898982 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] planet: if on bullseye, install package contents via puppet

https://gerrit.wikimedia.org/r/898982

I very much appreciate and depend upon the planet service so happy to spend some time working on it if it would be useful...

In T281219#7051813, @MoritzMuehlenhoff wrote:

https://github.com/rubys/venus/issues/37 points to https://github.com/feedreader/pluto which is written in Ruby and still seems to be actively maintained.

pluto hasn't had a commit since Oct 2020 :(

In T281219#8099518, @MoritzMuehlenhoff wrote:

Also: https://grep.be/blog//en/computer/Planet_Grep_now_running_PtLink/

ptlink last had a commit 7 months ago (https://salsa.debian.org/wouter/ptlink), but knowing the author it's probably stable enough, though it's not packaged in Debian AFAICT. It is perl, which is (my impression) less preferred at Wikimedia but not a dealbreaker.

I skimmed the buster version of the rawdog code, I'd estimate it would take like a week to port to Python 3 if we could rip out features Wikimedia doesn't use. I'd also be willing to write a new planet that addresses stuff like T207244 if I'm allowed to do it in Rust.

In T281219#8726273, @Legoktm wrote:

I'd also be willing to write a new planet that addresses stuff like T207244 if I'm allowed to do it in Rust.

That would be fantastic :-) If it only uses rustc and crates found in bookworm, that would be perfect, but given the static ELF nature of Rust binaries it's also not a problem to build on sid and then import (that's what we also do with various Go code bases in the moment)

Change 898982 abandoned by Dzahn:

[operations/puppet@production] planet: if on bullseye, install package contents via puppet

Reason:

https://gerrit.wikimedia.org/r/898982

https://gitlab.wikimedia.org/legoktm/planet is what I have so far, the basic structure is in place and it works, but is really rough. The README outlines the remaining work in rough priority order.

Another option which will be used for Planet Debian: https://grep.be/blog//en/computer/ptlink/Planet_Debian_rendered_with_PtLink/

legoktm opened https://gitlab.wikimedia.org/legoktm/rawdog/-/merge_requests/1

Draft: Port to Python 3 and other improvements

legoktm merged https://gitlab.wikimedia.org/legoktm/rawdog/-/merge_requests/1

Port to Python 3 and other improvements

There's still some TODOs left in https://gitlab.wikimedia.org/legoktm/rawdog but in my limited local testing, it seems to work. I'll do another pass in a few days (I also want to add some Python CI tools) before uploading to apt.wikimedia.org. I also pushed up a puppet patch that should make all the necessary changes (but that too needs more work).

I amended to Legoktm's puppet change that was in Gerrit, in a way that it was noop on existing buster servers while adding support for the new version. Then once I could confirm noop in prod I merged it.

Now next step is to get the package built.

Then we can create new VMs on bookworm and try things out there.

I git pulled from the gitlab repo to build2001 and was able to succesfully build the package.

Then uploaded all files to apt1001, edited the .changes file to have "bookworm" rather than "unstable" as distribution name and then
I could import it into wikimedia-bookworm with reprepro.

[apt1001:~] $ sudo -E reprepro ls rawdog
rawdog | 3.0.0 | bookworm-wikimedia | amd64, source

Meanwhile we have 2 new VMs with bookworm, planet puppet role applied and new package installed.

I had to make a small change to remove the "plugindir" config line if not on buster. Details in T348392.

After that I could run a test update of feeds but ran into this:

Nov 27 23:29:54 planet1003 rawdog[39961]:     rc = feed.update(self, now, config, articles, content)
Nov 27 23:29:54 planet1003 rawdog[39961]:          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 27 23:29:54 planet1003 rawdog[39961]:   File "/usr/lib/python3/dist-packages/rawdog/rawdog.py", line 447, in update
Nov 27 23:29:54 planet1003 rawdog[39961]:     if len(responses) > 0:
Nov 27 23:29:54 planet1003 rawdog[39961]:        ^^^^^^^^^^^^^^
Nov 27 23:29:54 planet1003 rawdog[39961]: TypeError: object of type 'NoneType' has no len()
Nov 27 23:29:54 planet1003 systemd[1]: planet-update-fr.service: Main process exited, code=exited, status=1/FAILURE
Nov 27 23:29:54 planet1003 systemd[1]: planet-update-fr.service: Failed with result 'exit-code'.

^ I got this error fixed. And built version 3.0.2 of the package.

I can now succesfully update feeds and should be all done.

Merge request is at https://gitlab.wikimedia.org/legoktm/rawdog/-/merge_requests/2

Optimistically closing this as resolved.

Also it's now a duplicate of T348392 :) yay