We can leverage ssh tunneling to directly browse the server history UI. We should document how to do it.
$ cat /etc/hosts 127.0.0.1 localhost spark-history-test.svc.eqiad.wmnet $ ssh -N -L 30443:spark-history-test.svc.eqiad.wmnet:30443 deploy2002.codfw.wmnet
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | brouberol | T330176 [Data Platform] Deploy Spark History Service | |||
| Resolved | brouberol | T353232 Document how to browse the History server locally |
I have created https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Spark_History, which contains the appropriate instructions.