Some of the issues we're working on during the WMDE-References-FocusArea affect how user can interact with the VisualEditor.
Assumptions:
- Users don't use the reference re-use dialog in VE because it's faulty and incomplete in some cases.
- Fixing the issues around the re-use dialog will increase it's usage.
- Fixing use cases about the usage of references in VE will increase how people add and re-use references there.
- Users switch back and forth between visual and Wikitext mode to create/reuse/edit references
- Fixing use cases about the usage of references in VE will decrease the need to switch back and forth
Indicators:
- Users use the cite and re-use dialogs more often per session.
- Users use the cite and re-use dialogs more successfully.
- Users will less often need to switch between Wikitext mode and visual mode per session.
Measurements:
T362347: Log events for some simple interactions in the VE cite dialogs:
- Opens of the cite dialog. Make sure this works with/without Citoid.
- Opens of the re-use tab
- Actively uses of the re-use dialog ( defined by interacting with the search box/scrolling through the list ). This is sticky per opening of the dialog, so we are recording either 0 or 1.
- Left the re-use dialog after actively using it without adding a reference re-use (e.g. pressing Esc or clicking outside of the dialog).
- Left the re-use dialog successfully by adding a reference re-use
- Tries to add a new reference using the dialog. We don't care if this actually ended in a new reference being added to the article, only that a selection in the cite dialog was made.
T362358: Log events for copy and paste action around references in VE
- How often users paste from the clipboard and create a new reference by doing so.
- How often users paste and create a reference re-use with that
- Make sure we have a baseline for the number of edit sessions with VE to normalize the above values to.
- Switches between VE and wikitext editing per edit session. Which wikitext editor is used is not relevant, but we must make sure they are all tracked.
See editor-switch in https://www.mediawiki.org/wiki/VisualEditor/FeatureUse_data_dictionary
Also consider:
Was the "citation tool" in use, or the plain cite dialog?( irrelevant here )- Track edit session ID in the raw data. While we don't care about individual users but only need trends over time, we need sessions for normalization and for grouping. Most notably when users switch a lot between editors and start doing this less often.
- VE events are normally sampled heavily, at 6.25%. However, wgWMESchemaVisualEditorFeatureUseSamplingRate and wgWMESchemaEditAttemptStepSamplingRate were set to 100% last year and seems to have been left this way.
- Data retention should be considered: VE schemas are already configured to save "sanitized" data after 30 days, but if we add a new schema we will also need to configure sanitization in https://github.com/wikimedia/analytics-refinery/blob/master/static_data/sanitization/event_sanitized_analytics_allowlist.yaml