In the New Discussion Tool AB test, how can we distinguish and include people that previously used the New Discussion Tool in the AB test?
As @DLynch noted in T291307#7366524, we are not yet sure how – if at all – we can ensure the only people who are excluded from the A/B are those who have used the New Discussion Tool before. Update: Instead of excluding people that have used the new discussion tool before, we think it would be more beneficial if we can include and distinguish these users in the test. However, this will still require us to be able to find a reliable way to differentiate prior reply tool users vs prior discussion tool users.
This task involves the work with figuring the above out.
- 1. How can we ensure that we are able to identify and differentiate people who have used the New Discussion Tool before in the AB test?
- We're going to store a preference of some kind. The implementation and requirements that will guide this implementation are now documented in T294167
- Note: Whatever trigger/event/value we use should NOT collide with anything that's set by the reply tool. Said another way: we are looking for a trigger that'd ignore usage of the reply tool. E.g. discussiontools-editmode preference is not empty would not let us know which tool (new discussion or reply tool) the person used.
- All ===Open questions are answered and documented in this ticket