Page MenuHomePhabricator

Trigger a castor save when operations/puppet change are merged and change dependencies
Closed, ResolvedPublic

Description

Castor only saves gem/pip cache on gate-and-submit / postmerge jobs. For operations/puppet.git we need a job that would refresh the cache for us when Gemfile or tox.ini are altered.

Event Timeline

Change 359429 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Castor save operations/puppet postmerge

https://gerrit.wikimedia.org/r/359429

Change 359429 merged by jenkins-bot:
[integration/config@master] Castor save operations/puppet postmerge

https://gerrit.wikimedia.org/r/359429

Change 359436 had a related patch set uploaded (by Hashar; owner: Hashar):
[operations/puppet@production] (DO NOT SUBMIT) cache save test

https://gerrit.wikimedia.org/r/359436

hashar claimed this task.

I have manually simulated the reaction to a merge of the dummy change https://gerrit.wikimedia.org/r/359436

contint1001$ zuul enqueue --trigger gerrit --pipeline postmerge --project operations/puppet --change 359436,1

Console P5586

castor-save console P5587

Syncing cache
From.. 10.68.23.7
To.... /srv/jenkins-workspace/caches/operations-puppet/production/operations-puppet-tests-jessie

Which is the path for the job triggered from test. Cache content looks good on castor.integration.eqiad.wmflabs.

I did a recheck of my dummy patch and it seems to benefit from caching. Notably bundler output only Using ... lines:

00:00:37.088 Resolving dependencies...
00:00:37.102 Using rake 12.0.0
00:00:37.103 Using CFPropertyList 2.2.8
00:00:37.103 Using ast 2.3.0
00:00:37.103 Using diff-lcs 1.3
00:00:37.103 Using facter 2.4.6
00:00:37.103 Using git 1.3.0
00:00:37.103 Using json_pure 2.1.0
00:00:37.104 Using hiera 1.3.4
00:00:37.104 Using metaclass 0.0.4
00:00:37.104 Using mocha 1.2.1
00:00:37.104 Using parallel 1.11.2
00:00:37.104 Using parser 2.4.0.0
00:00:37.104 Using powerpack 0.1.1
00:00:37.105 Using puppet 3.8.7
00:00:37.105 Using puppet-lint 2.0.2
00:00:37.106 Using yard 0.9.9
00:00:37.109 Using puppet-strings 1.0.0
00:00:37.110 Using puppet-syntax 2.4.0
00:00:37.110 Using rspec-support 3.6.0
00:00:37.110 Using rspec-core 3.6.0
00:00:37.111 Using rspec-expectations 3.6.0
00:00:37.111 Using rspec-mocks 3.6.0
00:00:37.111 Using rspec 3.6.0
00:00:37.111 Using rspec-puppet 2.3.2
00:00:37.111 Using puppetlabs_spec_helper 1.2.2
00:00:37.112 Using rainbow 2.2.2
00:00:37.112 Using ruby-progressbar 1.8.1
00:00:37.112 Using unicode-display_width 1.2.1
00:00:37.112 Using rubocop 0.49.1
00:00:37.112 Using safe_yaml 1.0.4
00:00:37.112 Using bundler 1.7.4
00:00:37.115 Your bundle is complete!

Change 359441 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] castor: save pip HTTP cache

https://gerrit.wikimedia.org/r/359441

https://gerrit.wikimedia.org/r/359441 is because I found out that castor did not save ~/.cache/pip/http.

Change 359441 merged by jenkins-bot:
[integration/config@master] castor: save pip HTTP cache

https://gerrit.wikimedia.org/r/359441

Change 359436 abandoned by Hashar:
(DO NOT SUBMIT) cache save test

https://gerrit.wikimedia.org/r/359436