Background
As part of KR2.4, and in order to enable testing with anonymous users, our data platform infrastructure and the user-facing tool to configure data collection artifacts – xLab – have been undergoing a series of design changes. The “Traffic and variations” section (currently “Sampling”) in the experiment configuration form will concentrate most of the adjustments:
- T392899: xLab: Add User identifier type field
- T390036: xLab: Simplify groups and feature values
- T392898: xLab: Add validation to the Duration field
- T392911: xLab: Update ‘Project and sample size’ module
Goal
Some of xLab’s prospective users are familiar with the tool and its sampling configuration due to a previous round of usability testing. One of the most relevant insights extracted from that round of testing was related to the technical barrier of entry posed by xLab’s UI. Our commitment is to keep improving the understandability of our custom tool.
In order to make sure that the new configuration fields are understandable and aligned with their mental model, we should validate our changes with experiment owners via a new round of lean usability testing.
Acceptance criteria
- We validate the latest UI changes applied to xLab with its prospective users
- We apply the necessary adjustments to the new fields, based on the insights extracted from usability testing