Gadget usage statistics
OpenPublic

Assigned To
None
Priority
Low
Author
Cacycle
Subscribers
Aklapper, Meno25, PeterBowman and 18 others
Projects
Tokens
"Like" token, awarded by Ltrlg."Like" token, awarded by He7d3r."Like" token, awarded by Qgil."Like" token, awarded by Kozuch."Like" token, awarded by Steinsplitter."Like" token, awarded by Nemo_bis.
Security
None
Reference
bz19288
Description

It would help immensely if there was a gadget usage statistic implemented in MediaWiki.

Knowing the usage patterns of gadgets would allow to identify rarely used and too exotic gadgets that would be better used as a traditional user script. This would help in maintaining the gadget selection list at a user friendly size and would also help to prioritize gadget development.

In addition to the absolute numbers, the most meaningful information would be about "active users", with single-use testing-only accounts and dormant accounts excluded. A simple definition of "active user" could be someone who has registered more than two months ago and was active during the last month.


Version: unspecified
Severity: enhancement
See Also:
T27302: Enable UserOptionStats extension on Hungarian Wikipedia
T60196: Tool Labs: Provide anonymized view of the user_properties table
T61480: Gadget usage statistics for Portuguese Wikipedia

bzimport added a subscriber: Unknown Object (MLST).
bzimport set Reference to bz19288.
Cacycle created this task.Via LegacyJun 19 2009, 1:40 AM
Nikerabbit added a comment.Via ConduitJun 19 2009, 8:18 AM

Oh on yet another definition of an "active user". But seriously, it should be very easy to query how many have enabled some gadget in the new preferences system. It can be done with the old preferences system too, or both [1], but that has some performance concerns.

[1] http://translatewiki.net/wiki/Special:UserOptionStats

Quiddity added a comment.Via ConduitMay 17 2014, 5:46 PM

This exists!

(Use this date format: 2014-05-01)

Old version (works intermittently; can take up to 1 minute when it does work)
https://toolserver.org/~liangent/gadget_usage/

New version (broken, waiting for bug 58196 to be resolved)
http://tools.wmflabs.org/liangent-django/gadget_usage/

@liangent: I'd suggest adding the "total number of accounts" to the output. Currently it takes 2 queries to do that, and it's nearly always a useful comparison number.
I.e. The top item at Enwiki, has 9002 total users, and 1724 users active since 2014-05-01.

See also bug 25302 (as Helder linked), which aims to give stats for all user-preferences, but also seeks to add a "limit to active users" option.

liangent added a comment.Via ConduitMay 18 2014, 6:54 AM

(In reply to Quiddity from comment #2)

@liangent: I'd suggest adding the "total number of accounts" to the output.
Currently it takes 2 queries to do that, and it's nearly always a useful
comparison number.
I.e. The top item at Enwiki, has 9002 total users, and 1724 users active
since 2014-05-01.

Hmm it does have to take 2 (SQL) queries, and as it's already running very slowly with one query I'm afraid it'll be slower or eventually timeout (not sure about configurations on the webserver) if I add more.

Quiddity added a comment.Via ConduitMay 18 2014, 7:06 AM

(In reply to Liangent from comment #3)

Hmm it does have to take 2 (SQL) queries, and as it's already running very
slowly with one query I'm afraid it'll be slower or eventually timeout (not
sure about configurations on the webserver) if I add more.

Would it be possible to save [cache?] that "total accounts" number for [1 month]?
Maybe even in a log file, so that we can track the overall growth over time?
There's a lot of interesting stats, just waiting to be graphed. :D

yuvipanda added a comment.Via ConduitAug 14 2014, 7:12 PM

Since Toollabs doesn't have gadget usage info, I guess we could instead generate this as a report on stat1003 and make it available on an ongoing basis as a CSV from there. I could work on it if there's still interest.

Quiddity added a comment.Via ConduitAug 14 2014, 8:14 PM

(In reply to Yuvi Panda from comment #6)

Since Toollabs doesn't have gadget usage info, I guess we could instead
generate this as a report on stat1003 and make it available on an ongoing
basis as a CSV from there. I could work on it if there's still interest.

Uptodate stats on gadgets (and all preferences), would be very appreciated.

Ideally, it would save monthly totals, so that we could compare changes over time.

Ideally, it would be filterable by (wiki / user activity / user right / account age / etc )

See also:
https://meta.wikimedia.org/wiki/Gadgets (last updated in April)
https://en.wikipedia.org/wiki/Wikipedia:Database_reports/User_preferences#Gadgets (last updated in June)
http://tools.wmflabs.org/liangent-django/gadget_usage/ (broken, waiting for bug 58196 )

Re: All Preferences, see (2012) https://trello.com/c/o2sdB6BI/15-user-preferences-stats and (ongoing) https://trello.com/c/HxlbhRzm/88-analysis-of-preference-logged-data

(Tangentially, see my ramble about what we should also do with gadget-usage numbers, at https://www.mediawiki.org/wiki/Talk:Requests_for_comment/Redesign_user_preferences#Gadgets

He7d3r added a comment.Via ConduitAug 14 2014, 8:25 PM

(In reply to Quiddity from comment #7)

Ideally, it would be filterable by (wiki / user activity / user right /
account age / etc )

...and also by default status: enabled / disabled for all users.

Qgil added a comment.Via ConduitAug 15 2014, 11:22 AM

(In reply to Yuvi Panda from comment #6)

if there's still interest.

There is! I believe we need to know more about the most used gadgets and templates -- for many reasons. This, in turn, will allow us to know more about who develops those gadgets and templates, a type of work that is essential to Wikimedia.

GOIII added a comment.Via ConduitAug 25 2014, 11:17 PM

(In reply to Yuvi Panda from comment #6)

if there's still interest.

YES PLEASE! In agreement with comment #7 here too.

yuvipanda added a comment.Via ConduitAug 25 2014, 11:19 PM

My spare time has currently been taken up by providing public 'edits per country' data (see the analytics mailing list), so will try to get to this in the next few weeks.

Nemo_bis awarded a token.Via WebDec 12 2014, 8:02 AM
Steinsplitter awarded a token.Via WebDec 15 2014, 7:42 PM
Kozuch awarded a token.Via WebDec 17 2014, 8:36 PM
He7d3r edited the task description. (Show Details)Via WebFeb 22 2015, 8:40 PM
He7d3r added a project: Analytics.
He7d3r set Security to None.
Qgil awarded a token.Via WebFeb 22 2015, 8:46 PM

Could this be a #Possible-Tech-Project for GSoC / Outreachy?

NiharikaKohli added a subscriber: NiharikaKohli.Via WebFeb 23 2015, 1:48 PM
Rits added a subscriber: Rits.Via WebMar 3 2015, 10:32 PM
NiharikaKohli added a comment.Via WebMar 4 2015, 3:06 PM

@yuvipanda, willing to mentor this for the upcoming GSoC/Outreachy round? Is this big enough for a 3-month project?

yuvipanda added a comment.Via WebMar 4 2015, 3:07 PM

@NiharikaKohli sadly even starting on this requires a signed NDA with the WMF and access to the stat* boxes, so I'd say this is out of reach for GSoC...

NiharikaKohli added a comment.Via WebMar 4 2015, 3:08 PM

@yuvipanda, right. Thanks for clarifying.

NiharikaKohli moved this task to Missing Mentors on the Possible-Tech-Projects workboard.Via WebMar 4 2015, 3:08 PM
NiharikaKohli moved this task to Re-check in August 2015 on the Possible-Tech-Projects workboard.
Se4598 added a comment.Via WebMar 4 2015, 5:22 PM

@yuvipanda: I don't know which infos are all on stat*, but relative easy queries can already be made together with Extension:AccountAudit like

SELECT up_property, up_value, COUNT(*) AS count FROM user_properties INNER JOIN accountaudit_login ON aa_user = up_user WHERE up_property LIKE "%gadget%" AND aa_lastlogin > '201404' GROUP BY up_property, up_value ORDER BY count;

(the query run in August 2014 and needed 1 min 32 sec for dewiki)

Therefore I wonder which special infos are there (stat*) you expect to be needed, which can't be provided via the extension on a local (vagrant) mw-setup?

PeterBowman added a subscriber: PeterBowman.Via WebApr 6 2015, 11:29 PM
He7d3r awarded a token.Via WebWed, Aug 12, 6:16 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptVia HeraldWed, Aug 12, 6:16 PM
Ltrlg awarded a token.Via WebSat, Aug 15, 9:18 PM

Add Comment