TODO: check that German Wikipedia on the beta cluster has FlaggedRevs settings roughly matching production.

@MSantos I looked into the process for rebuilding, tagging, and deploying the kartotherian service, and I'm afraid I'll have to leave it to your team. If it makes sense and you have the time, I would be happy to learn, maybe by watching you run through the steps, but I had no success following the existing docs or using the ./server.js build command.

The good news is that the production deployment seems to be up to date with the main branch so our changes can be deployed without a backport. But our next step is to deploy to the beta cluster, and I notice that you have an experimental kartotherian branch imposm_beta deployed there since July. Is it okay if we push our own experimental code to beta?

@awight I think it would be useful to sync with you, because we're not using the deployment-prep instance for maps anymore, instead we've created a new service for the Tilerator replacement with Tegola.

Change 745490 had a related patch set uploaded (by Awight; author: Awight):

[operations/mediawiki-config@master] beta: enable Kartographer versioned maps

https://gerrit.wikimedia.org/r/745490

Change 745490 merged by jenkins-bot:

[operations/mediawiki-config@master] beta: enable Kartographer versioned maps

https://gerrit.wikimedia.org/r/745490

Now that the production package exists, I can probably deploy to beta myself.

There were issues which blocked puppet updates on maps-experiments, the fix was to add and update these lines in maps-puppetmaster02.maps-experiments.eqiad1.wikimedia.cloud:/var/lib/git/labs/private/hieradata/maps-experiments.yaml:

profile::maps::osm_master::eventgate_endpoint: 'http://deployment-eventgate-3.deployment-prep.eqiad.wmflabs:8292/v1/events'
scap::deployment_server: deployment-deploy03.deployment-prep.eqiad1.wikimedia.cloud

Unfortunately, tilerator and tilerator-ui are still repeatedly crashing with this message from the parent process, with no other explanation:

maps-master01 tileratorui[3380]: Parent is shutting down, bye...

Maybe a minor thing or possibly related, I found this failure:

Dec 20 13:00:02 maps-master01 send-tile-expiration-events[15451]: +++ basename '/srv/osm_expire/*'
Dec 20 13:00:02 maps-master01 send-tile-expiration-events[15451]: ++ date -d '*' +%s
Dec 20 13:00:02 maps-master01 send-tile-expiration-events[15451]: date: invalid date ‘*’

I worked around by,

touch /srv/osm_expire/2021-12-20

The released kartotherian 1.1.10 package already includes our versioned maps support. The kartotherian-package and kartotherian-deploy repos are already at this release level.

I've created merge patches from imposm to master for each repo, please feel free to use or change as needed. Merging these is not a requirement for our work.

Change 755391 had a related patch set uploaded (by Awight; author: Awight):

[operations/mediawiki-config@master] [beta] Maps will be provided by the maps-experiments kartotherian

https://gerrit.wikimedia.org/r/755391

Change 755391 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] Maps will be provided by the maps-experiments kartotherian

https://gerrit.wikimedia.org/r/755391