role::hadoop will not provision on Ubuntu 14.04 (MediaWiki-Vagrant default)
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	bd808
	Jul 20 2014, 8:49 PM

Description

default: Error: /Stage[main]/Cdh::Hadoop/Package[hadoop-client]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install hadoop-client' returned 100: Reading package lists...
default: Building dependency tree...
default: Reading state information...
default: E: Unable to locate package hadoop-client

This failure leads to a giant cascade of "Skipping because of failed dependencies" errors.

There are also numerous Puppet 3.x deprecation warnings for erb templates that are not using '@' to identify variables used from Puppet scope:

manifests/hadoop.pp
templates/hadoop/hadoop-env.sh.erb
templates/hadoop/hdfs-site.xml.erb
templates/hadoop/mapred-site.xml.erb
templates/hadoop/yarn-env.sh.erb
templates/hadoop/yarn-site.xml.erb

Details

Reference: bz68302

	Subject	Repo	Branch	Lines +/-
	Updates for CDH 5.3.1 (Hadoop)	mediawiki/vagrant	master	+33 -24

Customize query in gerrit

Related Objects

Mentioned In: rMWVAee7036951d5e: Updates for CDH 5.3.1 (Hadoop)

Event Timeline

• bzimport raised the priority of this task from to Medium.Nov 22 2014, 3:33 AM

• bzimport added a project: MediaWiki-Vagrant.

• bzimport set Reference to bz68302.

bd808 created this task.Jul 20 2014, 8:49 PM

otto wrote:

Ja oof, we don't use Trusty in production yet, so none of the packages are available for it.

bd808 updated the task description. (Show Details)Dec 30 2014, 5:33 PM

bd808 set Security to None.

Should we remove the analytics, hadoop, hive, hue, and oozie roles until somebody ports the required packages to Trusty or is there another work around that we can use to fix this?

This is a chicken/egg problem I'm currently stuck in. CDH 5.2 is now available for Trusty. I have mostly upgraded production nodes to Trusty. I don't want to add the new .debs for Trusty into our production apt until I am ready for production nodes to be upgraded to Trusty.

If you don't mind waiting, I'm hoping to have the production cluster upgraded within a month or two (depending on some node procurement and an upstream bug fix). In the process of doing so I will make sure that vagrant works too.

bd808 changed the task status from Open to Stalled.Dec 30 2014, 5:56 PM

bd808 assigned this task to Ottomata.

yuvipanda unsubscribed.Jan 12 2015, 11:59 AM

Change 191472 had a related patch set uploaded (by Ottomata):
Updates for CDH 5.3.1 (Hadoop)

https://gerrit.wikimedia.org/r/191472

Patch-For-Review

Change 191472 merged by Ottomata:
Updates for CDH 5.3.1 (Hadoop)

https://gerrit.wikimedia.org/r/191472