Page MenuHomePhabricator

Improve PCC support for cloud VPS environments
Closed, ResolvedPublic

Description

Often when users make changes to the production environment they forget to run PCC on some of the cloud services infrastructure. It would be nice if we had a list of modules which where shared by both Cloud VPS hosts and production hosts, we could then potentially use this list to indicate the need for or automatically trigger a pcc run on a bunch of cloud VPS systems.

Further we should also explore genral improvements for PCC which would help both cloud and WMCS. some ideas i which i think would be nice

  • add support for running PCC on hosts in both cloud and production environments
  • add an option to test on one random (or possibly hardcoded) host from both the cloud and wmcs environments
  • investigate if we can add cloud hosts to the compiler puppetdb instance (which would allow the cumin like hosts syntax)
  • investigate if we can do some intelligent pruning for the hosts:re filter
  • investigate pruning cloud projects imports e.g. filter out fullstack-$datastamp
  • look at automatically updating compiler facts

Event Timeline

jbond triaged this task as Medium priority.Aug 25 2021, 9:31 AM
joanna_borun changed the task status from Open to In Progress.Sep 21 2021, 1:38 PM
jbond renamed this task from Gather a list of puppet modules shared between cloud and production to Improve PCC support for cloud VPS environments.Oct 5 2021, 10:33 AM
jbond added a project: Puppet CI.
jbond updated the task description. (Show Details)
jbond removed subscribers: taavi, Aklapper, bd808 and 6 others.
jbond updated the task description. (Show Details)

add an option to test on one random (or possibly hardcoded) host from both the cloud and wmcs environments

This is still outstanding

investigate pruning cloud projects imports e.g. filter out fullstack-$datastamp

We added a specific filter in the import script:
https://github.com/wikimedia/puppet/blob/production/modules/puppet_compiler/files/pcc_facts_processor.py#L58

Change 853382 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/software/puppet-compiler@master] controller: Add option for basic pcc run

https://gerrit.wikimedia.org/r/853382

Change 853382 merged by jenkins-bot:

[operations/software/puppet-compiler@master] controller: Add option for basic pcc run

https://gerrit.wikimedia.org/r/853382

jbond updated the task description. (Show Details)

With the basic selector announced yesterday i think we have all actions complete so will resolve but please re-open with an update if there are further actions