Page MenuHomePhabricator

Compare TemplateWizard and VisualEditor template dialog opens
Closed, ResolvedPublic1 Estimated Story Points

Description

We need to understand the prevalence of using TemplateWizard, vs. VisualEditor's template dialog, for making product decisions. Ideally, we can compare the number of opens for each tool.

I've verified these metrics locally, but it would be nice to have a VisualEditor expert review to see if there are other ways to open the "Insert Template" dialog.

We're interested in the global usage, and also the German Wikipedia segment.

Conclusion:

For March 2020 on dewiki,

  • 1,164 (20%) TemplateWizard dialog opens, and
  • 4,640 (80%) VisualEditor insert template dialog opens.

Event Timeline

Moving into the current sprint to reflect that I've started looking at the task--we haven't officially prioritized, however.

Querying dewiki for March 2020:

select
  event.action,
  count(*)
from visualeditorfeatureuse
where
  year=2020
  and month=3
  and wiki='dewiki'
  and event.feature='transclusion'
  and (event.action='window-open-from-tool' or event.action='window-open-from-sequence')
group by event.action;

->
window-open-from-sequence       98
window-open-from-tool   192

----

select
  count(*)
from templatewizard
where
  year=2020
  and month=3
  and wiki='dewiki'
  and event.action='launch';

-> 1164

Scaling by the sampling factor for VE, this gives 1164 TemplateWizard dialog opens and 4640 VisualEditor insert template dialog opens.

awight set the point value for this task to 1.
awight updated the task description. (Show Details)
awight moved this task from Doing to Demo on the WMDE-QWERTY-Sprint-2020-04-01 board.

@awight Wow this is great! Thank you for putting this together so quickly. It's super helpful and looks like it confirms our assumptions.

Now that you have this set up, is it easy to see the numbers globally as well? I'd like to know if it's a similar ratio or if german wikipedia is a particularly heavy user of one or the other.

In T249313#6030954, @ecohen wrote:

Now that you have this set up, is it easy to see the numbers globally as well? I'd like to know if it's a similar ratio or if german wikipedia is a particularly heavy user of one or the other.

For sure, I'll just leave out the "dewiki" clause!

select
  count(*) / 0.0625 as scaled_count
from event.visualeditorfeatureuse
where
  year=2020
  and month=3
  and event.feature='transclusion'
  and (event.action='window-open-from-tool' or event.action='window-open-from-sequence');

-> 168,736  (already scaled to adjust for sampling)

---

select
  count(*)
from event.templatewizard
where
  year=2020
  and month=3
  and event.action='launch';

-> 36,623

The back-of-napkin result is that German Wikipedia is nearly representative of other wikis in this respect. Reoughly 1 out of 6 template dialogs are TemplateWizard for dewiki, and 1 out of 5 globally.

Great - thanks so much! I think this definitely justifies putting effort into the VE template dialog then @Lena_WMDE

awight moved this task from Demo to Done on the WMDE-QWERTY-Sprint-2020-04-01 board.
awight moved this task from Done to Demo on the WMDE-QWERTY-Sprint-2020-04-01 board.
thiemowmde moved this task from Demo to Done on the WMDE-QWERTY-Sprint-2020-04-01 board.