Page MenuHomePhabricator

Conduct analysis for Rabbit Holes 20 days after deployment
Closed, ResolvedPublic

Description

Background
  • Release date: Dec 6
  • 20 Days- Dec 26
The Task
  • Visualize and present the data in a way that is easily understandable to the team
  • Compare results to Recommended Content
Requirements
  • The data should be based on the metrics in the Epic
At 20 days:

Validation
10% of unique users that engage with experiment do so more than once in a 30 day period
5% higher internal referral clicks of recommended articles from people that engage with the experiment compared to those that did not engage with feature
5% higher clicks on suggestion based on search queries vs. click throughs to articles from suggested reading lists
5% higher clicks to view suggested reading list vs users that hit enter on search queries
65% or higher of feedback scores are positive

Guardrails
60% of feedback from in-app users are negative
10 community members from target group express negative sentiments

Curiosities
Do we see a difference in the retention rate for logged in users vs logged out users
How does the metrics from Rabbit hole compare to Recommended Content
Do we see higher pageviews for users that engage with the feature vs those that do not

Related Objects