[Dashboards] Migrate from Vagrant to Puppet config
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	mpopov
	Mar 24 2017, 10:49 PM

Description

Right now Discovery's dashboards (source) and Discovery's experimental dashboards (source) live as apps served by Shiny Server running inside a MediaWiki Vagrant container running inside a Labs instance. This was necessary when the dashboards were originally prototyped, but as they've grown (new features, computationally expensive procedures, more datasets) they've also become rather sluggish. Which makes sense because they're running underneath like 2-3 different layers of virtual abstraction.

A side effect of this is that the OS & the libraries running in instance and the OS & libraries running in the container are not automatically updated. The goal of this task is to finally start managing the dashboards via Ops' Puppet configs.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Add Shiny Server module and Discovery Dashboards role/profile	operations/puppet	production	+699 -0
	[WIP] moving dashboards to puppet	wikimedia/discovery/dashboard	master	+611 -4

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		mpopov	T161354 [Dashboards] Migrate from Vagrant to Puppet config
		Resolved		Gehel	T164603 Upload Shiny Server Debian package to WMF repository

Event Timeline

mpopov created this task.Mar 24 2017, 10:49 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 24 2017, 10:49 PM

I'll need to work with Mr. G on this one :)

Working on this will make our servers more secure and the dashboard should become a lot faster and smoother to use/display for the end user. We'll need to find a good time to have @Gehel help us out, hopefully in April 2017.

• debt moved this task from Needs triage to Up Next on the Discovery-Analysis board.Mar 28 2017, 8:19 PM

@mpopov and @chelsyx will start working on getting a good outline completed of the work expected to be done.

mpopov claimed this task.Apr 25 2017, 6:45 PM

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.

Change 346794 had a related patch set uploaded (by Bearloga; owner: Gehel):
[wikimedia/discovery/dashboard@master] [WIP] moving dashboards to puppet

https://gerrit.wikimedia.org/r/346794

gerritbot added a project: Patch-For-Review.May 1 2017, 10:08 PM

mpopov created subtask T164603: Upload Shiny Server Debian package to WMF repository.May 5 2017, 5:00 PM

Change 346794 abandoned by Bearloga:
[WIP] moving dashboards to puppet

Reason:
Switching to a patch for the real ops puppet repo

https://gerrit.wikimedia.org/r/346794

I have a ops-puppet repo patch ready to submit once T164603 is done and/or if there's a change-id that I can specify for Depends-On

mpopov removed a project: Patch-For-Review.May 8 2017, 10:12 PM

mpopov moved this task from In progress to Stalled/Waiting on the Discovery-Analysis (Current work) board.

mpopov mentioned this in T153856: Add lint/CI to all wikimedia/discovery analytics repositories.May 8 2017, 10:49 PM

Change 353571 had a related patch set uploaded (by Bearloga; owner: Bearloga):
[operations/puppet@production] Add Shiny Server module and Discovery Dashboards role

https://gerrit.wikimedia.org/r/353571

gerritbot added a project: Patch-For-Review.May 12 2017, 4:48 PM

• debt closed subtask T164603: Upload Shiny Server Debian package to WMF repository as Resolved.May 30 2017, 5:18 PM

mpopov moved this task from Stalled/Waiting to In progress on the Discovery-Analysis (Current work) board.Jun 5 2017, 5:49 PM

mpopov moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Jun 6 2017, 10:36 PM

Change 353571 merged by Gehel:
[operations/puppet@production] Add Shiny Server module and Discovery Dashboards role/profile

https://gerrit.wikimedia.org/r/353571