Page MenuHomePhabricator

Public folder on stat1005 for Discovery's A/B test reports
Closed, ResolvedPublic

Description

@chelsyx developed some scripts that produce an HTML report (akin to https://wikimedia-research.github.io/Discovery-Search-Test-BM25/) for Search Platform's A/B tests when running on stat1005 (specifically stat1005 due to T168683).

@Ottomata @Milimetric Similar to how analytics.wikimedia.org/datasets/ is the public version of stat1002:/a/published-datasets (soon to be stat1005:/srv/published-datasets), would it be possible to have a discovery.wikimedia.org/reports/ (for example) that points to a directory in stat1005:/srv? That way when a report is generated (not just by us, but also by folks on the Search Platform too), it goes into that directory, and then ~15min later is viewable online.

And not just the automated reports. It'd be nice to host reports like the one I linked to ourselves, rather than on GitHub :)

Event Timeline

mpopov created this task.Jul 20 2017, 4:15 PM
mpopov moved this task from Needs triage to Tracking on the Discovery-Analysis board.

Hm, would you mind if the report url was just analytics.wikimedia.org/datasets/discovery/reports/ ? If not, you could put stuff in published-datasets/discovery/reports/ now, and it will just work.

mpopov closed this task as Resolved.Jul 20 2017, 5:00 PM
mpopov claimed this task.

We're okay with that :)