Castor only saves gem/pip cache on gate-and-submit / postmerge jobs. For operations/puppet.git we need a job that would refresh the cache for us when Gemfile or tox.ini are altered.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • aborrero | T178717 Upgrade wmcs instances and masters to puppet 4.8 | |||
| Resolved | None | T177254 Upgrade to puppet 4 (4.8 or newer) | |||
| Resolved | None | T169548 Prepare for Puppet 4 | |||
| Resolved | None | T166888 CI for operations/puppet is taking too long | |||
| Resolved | hashar | T168063 Trigger a castor save when operations/puppet change are merged and change dependencies |
Event Timeline
Change 359429 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Castor save operations/puppet postmerge
Change 359429 merged by jenkins-bot:
[integration/config@master] Castor save operations/puppet postmerge
Change 359436 had a related patch set uploaded (by Hashar; owner: Hashar):
[operations/puppet@production] (DO NOT SUBMIT) cache save test
I have manually simulated the reaction to a merge of the dummy change https://gerrit.wikimedia.org/r/359436
contint1001$ zuul enqueue --trigger gerrit --pipeline postmerge --project operations/puppet --change 359436,1
Console P5586
castor-save console P5587
Syncing cache From.. 10.68.23.7 To.... /srv/jenkins-workspace/caches/operations-puppet/production/operations-puppet-tests-jessie
Which is the path for the job triggered from test. Cache content looks good on castor.integration.eqiad.wmflabs.
I did a recheck of my dummy patch and it seems to benefit from caching. Notably bundler output only Using ... lines:
00:00:37.088 Resolving dependencies... 00:00:37.102 Using rake 12.0.0 00:00:37.103 Using CFPropertyList 2.2.8 00:00:37.103 Using ast 2.3.0 00:00:37.103 Using diff-lcs 1.3 00:00:37.103 Using facter 2.4.6 00:00:37.103 Using git 1.3.0 00:00:37.103 Using json_pure 2.1.0 00:00:37.104 Using hiera 1.3.4 00:00:37.104 Using metaclass 0.0.4 00:00:37.104 Using mocha 1.2.1 00:00:37.104 Using parallel 1.11.2 00:00:37.104 Using parser 2.4.0.0 00:00:37.104 Using powerpack 0.1.1 00:00:37.105 Using puppet 3.8.7 00:00:37.105 Using puppet-lint 2.0.2 00:00:37.106 Using yard 0.9.9 00:00:37.109 Using puppet-strings 1.0.0 00:00:37.110 Using puppet-syntax 2.4.0 00:00:37.110 Using rspec-support 3.6.0 00:00:37.110 Using rspec-core 3.6.0 00:00:37.111 Using rspec-expectations 3.6.0 00:00:37.111 Using rspec-mocks 3.6.0 00:00:37.111 Using rspec 3.6.0 00:00:37.111 Using rspec-puppet 2.3.2 00:00:37.111 Using puppetlabs_spec_helper 1.2.2 00:00:37.112 Using rainbow 2.2.2 00:00:37.112 Using ruby-progressbar 1.8.1 00:00:37.112 Using unicode-display_width 1.2.1 00:00:37.112 Using rubocop 0.49.1 00:00:37.112 Using safe_yaml 1.0.4 00:00:37.112 Using bundler 1.7.4 00:00:37.115 Your bundle is complete!
Change 359441 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] castor: save pip HTTP cache
https://gerrit.wikimedia.org/r/359441 is because I found out that castor did not save ~/.cache/pip/http.
Change 359441 merged by jenkins-bot:
[integration/config@master] castor: save pip HTTP cache