'[[ https://wikitech.wikimedia.org/wiki/Analytics/Systems/Jupyter#Newpyter | Newypter ]]' is currently installed only on stat1008. It is running alongside of the old SWAP virtualenv based jupyterhub instance. To finish up this project, we should
[x] Update anaconda-wmf with new wmfdata release including [[ https://github.com/wikimedia/wmfdata-python/pull/15 | this PR ]].
[] Clean up pyspark kernels
-- [x] We don't want to support custom pyspark kernels anymore; users should use regular python kernels and load up spark themselves, probably via [[ https://github.com/wikimedia/wmfdata-python | wmfdata ]]. We need to add documentation on how to do this.
-- We can't actually remove these unless we know users aren't using them. Announcement should tell folks to stop, and we should remove these after we deprecate SWAP.
-- [x] Make python spark work a little smarter with yarn and anaconda.
[x] Re-Write good documentation in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Jupyter for the new system: https://wikitech.wikimedia.org/wiki/User:Ottomata/Jupyter
[x] Provision new jupyterhub setup on all stat boxes (this should just be applying the puppet class)
[] Make announcement asking users to switch to new conda based jupyterhub on a new port.
[] Set a date to decom SWAP.
[] Decom SWAP.
[] Remove all SWAP puppetization and documentation.