Show Metrics Dashboard for Beta Features
Open, LowPublic
Actions

Assigned To

None

Authored By

	MingleTerminator
	Dec 8 2014, 3:59 PM

Description

Narrative

As a manager or community member, I can view a metrics dashboard of usage data for Beta Features, so that I can learn how this tool is being used.

Acceptance Criteria

Implement a metrics dashboard to show usage data for Beta Features, as described on Trello: https://trello.com/c/CG7HMm8u/11-beta-features-adoption

The overall goal is to answer these questions:

How many users are opting into beta features?
What are the most popular features by number of enrolled users?
How many users are selecting the auto-enroll option for future features?
What proportion of users is disabling beta after trying it out?

What's the breakdown of adoption by user tenure?

These metrics would be visualized with LIMN dashboards. We would track this data on a daily basis, as well as on a cumulative basis.

Next Steps

Wishlist: It would be great if we could automatically consolidate all unique user stats for Beta Features from all sites, if possible. See current stats spreadsheet: http://ur1.ca/g3i8y

Metrics thus far

About Beta Features

https://www.mediawiki.org/wiki/Beta_Features

Earlier notes

Related Objects

Mentioned In: T258971: PrefUpdate event.isDefault field is not recoded correctly for some user properties
T85106: Simple run of CX beta feature enabling statistics

Event Timeline

MingleTerminator raised the priority of this task from to Needs Triage.Dec 8 2014, 3:59 PM

MingleTerminator added a project: Multimedia.

• Gilles added a project: BetaFeatures.Dec 8 2014, 4:38 PM

• Gilles triaged this task as Low priority.Dec 8 2014, 4:57 PM

• Gilles subscribed.

• santhosh subscribed.Dec 9 2014, 9:57 AM

Nikerabbit subscribed.Dec 9 2014, 10:00 AM

Amire80 set Security to None.Dec 21 2014, 4:32 PM

Amire80 added subscribers: leila, Halfak.

Amire80 mentioned this in T85106: Simple run of CX beta feature enabling statistics.Dec 21 2014, 4:56 PM

@MingleTerminator: The Trello card linked from this page is archived. Is this an ongoing request? If so, what's the status of it?

Tgr added subscribers: Pginer-WMF, Tgr.Dec 22 2014, 8:02 PM

In T77058#940355, @leila wrote:

@MingleTerminator: The Trello card linked from this page is archived. Is this an ongoing request? If so, what's the status of it?

I'm afraid that account is a bot and won't answer your question (but I'd welcome if the person who created it woould add that to the account's descriptiopn, just like https://phabricator.wikimedia.org/p/bzimport/ has). :)

thanks @Aklapper for letting me know.

In T77058#940355, @leila wrote:

@MingleTerminator: The Trello card linked from this page is archived. Is this an ongoing request? If so, what's the status of it?

The trello card is about a research project to determine the representativeness of BetaFeatures users. I think that would be extremely valuable to any team using BetaFeatures (Multimedia is not using it at the moment).

This task is about simple user count numbers for beta features, which is a fairly easy task. IMO it would be mildly useful, but one can easily get the numbers directly with a DB query as it is. The multimedia team is not using any beta features at the moment so I don't think this is an ongoing request from our side.

IIRC @Pginer-WMF was interested in something like this?

Jdforrester-WMF moved this task from Untriaged to Backlog on the Multimedia board.Sep 4 2015, 5:56 PM

Restricted Application added a subscriber: Matanya. · View Herald TranscriptSep 4 2015, 5:56 PM

Jdforrester-WMF removed a project: Multimedia.Sep 21 2015, 4:22 PM

This is now partially completed via @Addshore et als excellent work on
https://grafana.wikimedia.org/dashboard/db/betafeatures - (wikitech announcement)

How easy would it be, to get the remaining questions answered? (Do they need separate tasks?)

Is it possible to backfill any of the information? (James notes that https://edit-analysis.wmflabs.org/beta-enables/ has some earlier information, however it only shows the 2 features the Collaboration team has worked on. I'm not sure if that's tracking-but-not-displaying information for all betafeatures?)

Quiddity updated the task description. (Show Details)Jul 29 2016, 6:27 PM

Does this include users with the "Automatically enable all new beta features" option? IIRC a straight DB count ignores that.

phuedx mentioned this in T258971: PrefUpdate event.isDefault field is not recoded correctly for some user properties.Sep 11 2020, 11:32 AM

Addshore unsubscribed.Jun 27 2023, 12:34 PM