Maniphest T120285

Set up an experimental Discovery dashboard which people can push any graphs or features they want to
Closed, ResolvedPublic3 Story Points
Actions

Description

Use cases:

Graphs for features that people want to make themselves, but aren't high priority enough to get full analyst support
Trying out new dashboard features that may be hard and/or fragile

Related Objects
Search...

Status	Assigned	Task
Resolved	Ottomata	T147682 Can't install R package Boom (& bsts) on stat1002 (but can on stat1003)
Declined	mpopov	T112170 Model user behavior and detect when reality heavily deviated from expectation
Resolved	mpopov	T122937 Experimental forecast dashboard
Resolved	Ironholds_backup	T120135 Allow agent, spider, bot filtering on all dashboards
Resolved	Ironholds	T120284 Try adding a "bot filter" checkbox to a single dashboard metric, in an experimental environment, to gauge how much work it is to do it more generically
Resolved	mpopov	T120285 Set up an experimental Discovery dashboard which people can push any graphs or features they want to

Deskana created this task.Dec 3 2015, 9:24 PM

Deskana updated the task description. (Show Details)

Deskana raised the priority of this task from to High.

Deskana added projects: Discovery, Discovery-Analysis (Current work).

Deskana added a subscriber: Deskana.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 3 2015, 9:24 PM

Deskana added a parent task: T120284: Try adding a "bot filter" checkbox to a single dashboard metric, in an experimental environment, to gauge how much work it is to do it more generically.Dec 3 2015, 9:24 PM

mpopov claimed this task.Dec 3 2015, 10:28 PM

mpopov set Security to None.

mpopov edited a custom field.

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.

Smalyshev added a subscriber: Smalyshev.Dec 3 2015, 10:56 PM

Deskana moved this task from Needs triage to On Sprint Board on the Discovery board.Dec 4 2015, 5:16 AM

Change 257011 had a related patch set uploaded (by Bearloga):
Adds space for new dashboards

https://gerrit.wikimedia.org/r/257011

Change 257011 merged by Bearloga:
Adds space for new dashboards

https://gerrit.wikimedia.org/r/257011

mpopov added subscribers: • yuvipanda, EBernhardson.Dec 8 2015, 3:31 PM

This comment was removed by mpopov.

@EBernhardson Please help. For whatever reason https://github.com/wikimedia/wikimedia-discovery-dashboard works.

But https://github.com/wikimedia/wikimedia-discovery-experimental makes http://discovery-experimental.wmflabs.org return 502 Bad Gateway error.

I don't know why. Everything is basically identical. I spent all day yesterday trying to make it work but couldn't.

(The instance: https://wikitech.wikimedia.org/wiki/Nova_Resource:Discovery-experimental.shiny-r.eqiad.wmflabs)

i'll look into this this morning between meetings. An actual solution will probably take till some time this afternnoon due to ~1.5 hours of meetings this morning

Change 257645 had a related patch set uploaded (by EBernhardson):
Add missing directories

https://gerrit.wikimedia.org/r/257645

The attached patch should fix the issue, I've already tried this out on the discovery-experiemental server and everything looks to be happy now.

Mostly i found this by looking for shiny logs (find /var/log | grep shiny), and then looking at /var/log/upstart/shiny-server.log which contained the following:

/bin/sh: 1: /bin/sh: cannot create /srv/experimental/log/shiny-server.log: Directory nonexistent

Change 257645 merged by Bearloga:
Add missing directories

https://gerrit.wikimedia.org/r/257645

Thank you so much!!!

Homepage: http://discovery-experimental.wmflabs.org/

Repository: git clone https://gerrit.wikimedia.org/r/wikimedia/discovery/experimental

Instructions for adding dashboards: https://github.com/wikimedia/wikimedia-discovery-experimental/blob/master/README.md

The following script auto-updates the repository and any submodules that have been added: https://gerrit.wikimedia.org/r/#/c/257755/1/update-submodules.sh It has been scheduled to run every 5 minutes.

mpopov moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Dec 8 2015, 10:02 PM

Sooo, this is done then?