Better way to access Hadoop related web GUIs
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Ottomata
	Mar 5 2014, 4:00 PM

Description

Access to Hadoop and related web GUIs currently done via ssh tunnels and browser proxy settings: https://wikitech.wikimedia.org/wiki/Analytics/Kraken/Access
This setup is a little complicated for Toby and others, and also doesn't seem to work that well for some URLs. We'd like to figure out something easier. VPN? A locked down reverse proxy somewhere?

Details

Reference: rt6974

Subject	Repo	Branch	Lines +/-
Add yarn.wikimedia.org to DNS	operations/dns	master	+1 -0
Add analytics1001 as misc varnish backend	operations/puppet	production	+3 -3
Set up proxy on misc web to serve Hadoop Yarn ResourceManager UI at yarn.wikimedia.org	operations/puppet	production	+19 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
		Restricted Task
Resolved	Ottomata	T83601 Better way to access Hadoop related web GUIs
Resolved	Ottomata	T85834 Force Hue https redirects.
Resolved	Ottomata	T1200 Upgrade Analytics Cluster to Trusty, and then to CDH 5.3

Event Timeline

• rtimport raised the priority of this task from to Medium.Dec 18 2014, 1:50 AM

• rtimport added a project: ops-core.

• rtimport set Reference to rt6974.

Ottomata created this task.Mar 5 2014, 4:00 PM

Dependency by ticket #7027 added by aotto

faidon updated the task description. (Show Details)Jan 20 2015, 12:25 AM

faidon edited projects, added Analytics-Clusters; removed ops-core.

faidon changed the visibility from "WMF-NDA (Project)" to "Public (No Login Required)".

faidon changed the edit policy from "WMF-NDA (Project)" to "All Users".

faidon set Security to None.

I am planning on exposing a few services via misc-web-lbs. One of the dependencies is upgading to a newer version of CDH in order to force https for Hue.

Ottomata claimed this task.Jan 20 2015, 11:21 PM

Ottomata added subtasks: T85834: Force Hue https redirects., T1200: Upgrade Analytics Cluster to Trusty, and then to CDH 5.3.

Ottomata closed subtask T85834: Force Hue https redirects. as Resolved.Feb 23 2015, 10:26 PM

Ottomata closed subtask T1200: Upgrade Analytics Cluster to Trusty, and then to CDH 5.3 as Resolved.Feb 24 2015, 3:05 PM

Liuxinyu970226 subscribed.Feb 25 2015, 8:58 AM

Change 195298 had a related patch set uploaded (by Ottomata):
Set up proxy on misc web to serve Hadoop Yarn ResourceManager UI at yarn.wikimedia.org

https://gerrit.wikimedia.org/r/195298

gerritbot added a project: Patch-For-Review.Mar 9 2015, 4:40 PM

Change 195298 merged by Ottomata:
Set up proxy on misc web to serve Hadoop Yarn ResourceManager UI at yarn.wikimedia.org

https://gerrit.wikimedia.org/r/195298

Ottomata mentioned this in rOPUP4f7721128cb5: Set up proxy on misc web to serve Hadoop Yarn ResourceManager UI at yarn..Mar 9 2015, 4:44 PM

Change 195299 had a related patch set uploaded (by Ottomata):
Add analytics1001 as misc varnish backend