Page MenuHomePhabricator

Puppet config is broken for the maps instance on deployment-prep
Closed, ResolvedPublic

Description

From T290982

Puppet currently fails on deployment-maps08.deployment-prep.eqiad1.wikimedia.cloud:

Error: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install python3-maps-deduped-tilelist' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package python3-maps-deduped-tilelist
Error: /Stage[main]/Profile::Maps::Osm_master/Package[python3-maps-deduped-tilelist]/ensure: change from 'purged' to 'present' failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install python3-maps-deduped-tilelist' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package python3-maps-deduped-tilelist

Seems related to this task.

It looks like apt cannot find the package on deployment-maps08.deployment-prep.eqiad1.wikimedia.cloud

Event Timeline

I think the issue is that the maps production nodes are running on debian buster where deployment-prep is running on stretch. python3-maps-deduped-tilelist might only be available on buster.

Potential solutions:

  • Upload deb package for stretch edit: I don't think this can be done since the latest python available is 3.5 and package needs 3.7
  • Recreate the maps node to use buster

I think the latter is probably preferred in order maps deployment-prep instance to be better maintained and closer to prod.

Does anyone regularly use this instance for something? In other words, what would happen if we got rid of the instance instead of replacing it?

This instance is used as an environment for testing changes to the maps stack so its useful to keep it as part of the deployment-prep.

When are you planning on upgrading/fixing it? Puppet failures are causing it to get outdated compared other hosts and causing various annoying alerts, and Stretch needs to be removed from all of Cloud VPS by early next year anyways.

MSantos claimed this task.
MSantos added a subscriber: MSantos.

@Majavah for a while now we have been using the project maps-experiments for the beta cluster setup for maps. I've discussed with Yiannis and we agreed that we should decommission deployment-maps08.deployment-prep.eqiad1.wikimedia.cloud.

I have done that a few minutes ago. Thanks for raising the issue. I'll be bold and mark it as resolved, please let me know if there are any questions or concerns and please re-open in case I'm missing something.