Upgrade Spark to 1.5
Closed, DuplicatePublic
Actions

Assigned To

None

Authored By

	• ellery
	Dec 10 2015, 10:28 PM

Description

Running Spark 1.5 from a jar in my homedir does not always work. For example caching python RDDs does not work. Madhu and I just checked and you can cache python RDDs with 1.3, the current installation in the cluster.

I would like to use spark 1.5 since it supports python 3 and has much more advanced machine learning utilities.

Related Objects

Mentioned In: T119934: MW 1.26.0: Vector stylesheet doesn't load if temporary directory is unwritable

Event Timeline

• ellery created this task.Dec 10 2015, 10:28 PM

• ellery raised the priority of this task from to Needs Triage.

• ellery updated the task description. (Show Details)

• ellery added a project: Analytics-Backlog.

• ellery added subscribers: • ellery, Ottomata.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 10 2015, 10:28 PM

• ellery updated the task description. (Show Details)Dec 10 2015, 10:34 PM

• ellery set Security to None.

Ottomata closed this task as a duplicate of T119646: Upgrade to CDH 5.5 {hawk}.Dec 11 2015, 2:34 PM

saper mentioned this in T119934: MW 1.26.0: Vector stylesheet doesn't load if temporary directory is unwritable.Dec 19 2015, 9:25 PM

Upgrade Spark to 1.5Closed, DuplicatePublicActions

Description

Related Objects

Event Timeline

Upgrade Spark to 1.5
Closed, DuplicatePublic
Actions