2) role::spark should compile into a catalogue without dependency cycles
Failure/Error: it { is_expected.to compile }
error during compilation: Could not find resource 'Class[Cdh::Hive]' for relationship on 'Class[Cdh::Spark]' on node wmf-bd808-mbp01.local
# ./puppet/spec/integration/roles_spec.rb:20:in `block (3 levels) in <top (required)>'Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| analytics: remove cdh modules and roles | mediawiki/vagrant | stretch-migration | +0 -251 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | bd808 | T181353 [EPIC] Migrate MediaWiki-Vagrant base image to Debian Stretch | |||
| Open | None | T184151 role::spark should compile into a catalogue without dependency cycles |
Event Timeline
Comment Actions
Poking a bit deeper, there are a whole pile of things that need to be fixed with these roles:
- analytics
- hadoop
- hive
- hue
- oozie
- spark
The version of puppet/modules/cdh that is used in MediaWiki-Vagrant is quite a bit behind the version used in operations/puppet.git. Some resources have been renamed (e.g. ::cdh::hive::master -> ::cdh::hive::server). There are also package dependencies that conflict with core packages installed in MediaWiki-Vagrant:
==> default: Error: Evaluation Error: Error while evaluating a Resource Statement, Duplicate declaration: Package[openssl] is already declared in file /vagrant/puppet/modules/cdh/manifests/hue.pp:189; cannot redeclare at /vagrant/puppet/modules/postfix/manifests/init.pp:11 at /vagrant/puppet/modules/postfix/manifests/init.pp:11:5 on node vagrantdisposable.mediawiki-vagrant.dev
It looks like it may have been a couple years since @Ottomata or really anyone else touched these roles.
Comment Actions
Change 403341 had a related patch set uploaded (by BryanDavis; owner: Bryan Davis):
[mediawiki/vagrant@stretch-migration] analytics: remove cdh modules and roles
Comment Actions
Change 403341 merged by jenkins-bot:
[mediawiki/vagrant@stretch-migration] analytics: remove cdh modules and roles