T362379 is, among other things, creating an opportunity for us to more deeply understand how people are using Citoid and its role within the broader set of editing experiences, which is precisely what we'd like to use this ticket to do.
=== Decisions to be made
=== Research questions
1. How does Citoid usage vary by experience level and platform? [i]
-- //E.g. Of the people who published ≥1 unreverted edit to an article in the Wikipedia main namespace within the past 90 days, what proportion of them 1) successfully used Citoid to insert a citation and/or 2) opened Citoid ≥1?//|Research question|Metric(s)
-- //E.g. Of the published edits to content in the Wikipedia main namespace within the past 90 days, what proportion of them 1) involved someone opening Citoid and 2) what proportion of them involved someone successfully adding a new reference?//
2. How often do people open Citoid and successfully insert a reference?
-- //E.g. of the edits to content in Wikipedia's main namespace that involve someone using Citoid, what percentage of those edits also involve someone adding a new reference?//
3. Of the times when people open Citoid and do NOT follow through to insert a reference, what reasons explain why this might be the case?
-- Per what @mneisler and I talked about on 17 July, we're going to look at the following forms of unsuccessful citation insertions:|---|---
--- People abandoned the workflow|Who uses Citoid? //Asked another way: how does Citoid usage vary by experience level and platform?//| Of all the edits in the Wikipedia main namespace where Citoid is used, what proportion of these edits were completed by 1) brand new editors, 2) Junior Contributors, 3) Senior Contributors (grouped by platform (mobile / desktop)? //NOTE: "use" in this context means someone successfully tapped {nav Insert} to add a citation into the article they're editing.//
--- Citoid failed to generate a citation (`automatic-generate-fail`)|How heavily do people depend on Citoid to insert citations?|Of all the unreverted new content edits made with VE in the Wikipedia main namespace that add a new reference, what proportion of those edits did people use Citoid to make? What percentage of those edits did people use other means to add references? //NOTE: this question, knowingly excludes some edits people might use Citoid to make (e.g. adding a citation without adding any new content). We will broaden our investigation to include edits of this type if/when need be.//
--- No results were found for the input someone provided (`automatic-generate-fail-serch results`)
--- Network error while attempting to retrieve the necessary information (`automatic-generate-fail-netowrk:)
4.| To what extent are people finding success with Citoid?| **1)** Of the edits to content in Wikipedia's main namespace that involve someone using Citoid, what percentage of those edits involve people doing the following? //i)// Successfully/unsuccessfully inserting a reference (grouped by experience level and platform) and //ii)// Publishing/not publishing an edit with a new reference (grouped by experience level and platform) and **2)** Of the times when people open Citoid and do NOT follow through to insert a reference, what reasons explain why this might be the case? //E.g. people abandon the workflow, Of all the unreverted new content edits that include a reference made with VE in the main namespaceCitoid failed to generate a citation (`automatic-generate-fail`), what percentage of those edits did people use Citoid in?No results were found for the input someone provided (`automatic-generate-fail-serch results`), What percentage of those edits did people use other means to add references?Network error while attempting to retrieve the necessary information (`automatic-generate-fail-netowrk`)
5. ~~Of the citations people attempt to use Citoid to generate, what percentage of these attempts are for various content types (.mov, .pdf, url, etc.)?~~
-- //This is not currently measurable; see: T365583#9962638//
---
i. Editing interface is moot here seeing as how Citoid is only available within the visual editor and visual editor-based interfaces.