Change Details

“Engagement” metrics Primary metric: Time on site/ session length i.e. willingness to consume article summaries. Secondary metrics: Summaries completion rate i.e. willingness to complete a summary. Number of summaries consumed per session i.e. willingness to view subsequent summaries. Popular topics i.e. which topics had majority of reads.

====Background To be able to measure “Engagement” of wiki-highlights through an A/B test, we would need to instrument the sites. Our definition of engagement for this experiment is # Time on site/ session length i.e. willingness to consume article summaries. (Primary metric) # Summaries completion rate i.e. willingness to complete a summary. (Secondary) # Number of summaries consumed per session i.e. willingness to view subsequent summaries.(Secondary) # Popular topics i.e. which topics had majority of reads. (Secondary) [[ https://docs.google.com/spreadsheets/d/17mjrsZAlaYrYoPqMyoNrTQypUqgwYnH1bfVacbep1UY/edit?usp=sharing | Instrumentation Spec ]] ====Test Scenarios ====Open questions

“Engagement” metrics====Background Primary metric:To be able to measure “Engagement” of wiki-highlights through an A/B test, we would need to instrument the sites. Our definition of engagement for this experiment is # Time on site/ session length i.e. willingness to consume article summaries. (Primary metric) Secondary metrics: # Summaries completion rate i.e. willingness to complete a summary. (Secondary) Summaries completion rate i.e. willingness to complete a summary. # Number of summaries consumed per session i.e. willingness to view subsequent summaries.(Secondary) # Popular topics i.e. which topics had majority of reads. (Secondary) [[ https://docs.google.com/spreadsheets/d/17mjrsZAlaYrYoPqMyoNrTQypUqgwYnH1bfVacbep1UY/edit?usp=sharing | Instrumentation Spec ]] ====Test Scenarios ====Open questions