Page MenuHomePhabricator

Upgrade Spark to 1.5
Closed, DuplicatePublic

Description

Running Spark 1.5 from a jar in my homedir does not always work. For example caching python RDDs does not work. Madhu and I just checked and you can cache python RDDs with 1.3, the current installation in the cluster.

I would like to use spark 1.5 since it supports python 3 and has much more advanced machine learning utilities.

Event Timeline

ellery created this task.Dec 10 2015, 10:28 PM
ellery raised the priority of this task from to Needs Triage.
ellery updated the task description. (Show Details)
ellery added a project: Analytics-Backlog.
ellery added subscribers: ellery, Ottomata.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptDec 10 2015, 10:28 PM
ellery updated the task description. (Show Details)Dec 10 2015, 10:34 PM
ellery set Security to None.