Documentation added at https://wikitech.wikimedia.org/wiki/Maps/OSM

The approach of the CLI looks good to me. We should now see how to backport the script to debian buster to use on the maps clusters.

A couple of notes around this ticket:

What @Mholloway described is a feasible effort we could work on, but I believe that this ticket needs to be discussed on a product management level. How do you want to approach that? cc/ @JTannerWMF and @MattCleinman

In T285668#7343992, @akosiaris wrote:

In T285668#7342496, @Bstorm wrote:

In T285668#7342314, @MSantos wrote:

I am late to the party, but tiles.wmflabs.org is not part of the official Maps infrastructure. I'm not sure how its infrastructure works and I've limited time to help you setup currently, maybe next quarter, but @Bstorm if you need to sync and know what we have available in terms of maps OSM tooling, please ping me for a chat.

We now use imposm3 to import data and it would be interesting to see this project do more fancy stuff, like using OpenMapTiles.

There's two pieces to all this here. We've got a maps project in cloud (which tiles.wmflabs.org is hosted on) that is run by volunteers and whoever knows how to make it work and a Postgres OSM database that is run by my team. That database consumes the same puppet stack as the production WMF ones as far as I know.

I don't think that's true anymore (albeit it's a recent development). While puppet abstracts it a bit so that the same defines and classes are used, maps in production now uses imposm3 while the one in WMCS still uses osm2pgsql in order to populate the OSM database.

@akosiaris is right, the puppet config is backwards compatible and to use imposm3 you need to enforce it, so it doesn't change tooling for tiles.wmflabs.org

I am late to the party, but tiles.wmflabs.org is not part of the official Maps infrastructure. I'm not sure how its infrastructure works and I've limited time to help you setup currently, maybe next quarter, but @Bstorm if you need to sync and know what we have available in terms of maps OSM tooling, please ping me for a chat.

We worked around it testing the needed capabilities locally exposing the beta cluster metrics endpoint. I'll decline this since it won't be needed.

PR is at https://github.com/wikimedia/restbase/pull/1295 cc/ @Clarakosi and @Pchelolo

The populate_admin script is officially phased down after T269582 completion.

The fix seems to be applied. Please, re-open in case I'm missing something.

The fix seems to be applied, please re-open in case I'm missing something.

The fix seems to be applied in production, please re-open in case I'm missing something.

We'll be tracking this, for now, please let us know if there's anything else we can help with.

We haven't reached a permanent solution, but we have too many tasks to track the dark/black theme style issues. Because the original bug of this task is resolved, I'll mark it as resolved. Please refer to any further theme style issues at T286643: [EPIC] Systematic solution on preventing rendering issues on user styles between dark/light themes

The source of the failure could be this one in Wikifeeds https://logstash.wikimedia.org/app/discover#/doc/logstash-*/logstash-2021.09.07?id=jmADv3sB9aenX452CN2-, which has happened a lot in the timeframe observed.

@Ijm8710 I didn't have time to take a deep look into it, but it could be just cache being refreshed slowly.

As per T234843#5564733 and we don't plan to work on it in the foreseeable future, I'm going to decline this task. Please re-open in case I'm missing something.

Thanks @Nikerabbit this is very helpful! I'll just add more information into what you've already confirmed for posteriority:

I've separated the page/related specs in another task (T289575) since this one is done and deployed, please feel free to re-open in case it's needed.