Page MenuHomePhabricator
Paste P5832

Preliminary filter usage stats
ActivePublic

Authored by Catrope on Aug 1 2017, 1:05 AM.
Referenced Files
F8919312: Preliminary filter usage stats
Aug 1 2017, 1:20 AM
F8919308: Preliminary filter usage stats
Aug 1 2017, 1:19 AM
F8919284: Preliminary filter usage stats
Aug 1 2017, 1:05 AM
Subscribers
None
-- Total number events on enwiki between July 17 and 30 inclusive, broken down by beta vs non-beta
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' group by event_enhancedFiltersEnabled;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 86162 | -- Number of events in non-beta
| 1 | 33314 | -- Number of events in beta
+------------------------------+----------+
2 rows in set (6.15 sec)
-- Type of change group:
-- hidepageedits=1 ("Page edits" removed)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidepageedits=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 273 |
+------------------------------+----------+
1 row in set (13.94 sec)
-- hidenewpages=1 ("Page creations" removed)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidenewpages=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 2712 |
+------------------------------+----------+
1 row in set (4.69 sec)
-- hidelog=1 ("Logged actions" removed)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidelog=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 6 |
| 1 | 12630 |
+------------------------------+----------+
2 rows in set (4.19 sec)
-- hidecategorization=0 ("Categorization" shown) even though preference is set to hide categorization
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 left join enwiki.user_properties on up_user=event_userId and up_property='hidecategorization' where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidecategorization=0 and (up_value !='0' or up_value is null) group by event_enhancedFiltersEnabled;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 261 |
| 1 | 1 |
+------------------------------+----------+
2 rows in set (4.16 sec)
-- hidecategorization=1 ("Categorization" not shown) even though preference is to show categorization
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 left join enwiki.user_properties on up_user=event_userId and up_property='hidecategorization' where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidecategorization=1 and up_value='0' group by event_enhancedFiltersEnabled;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 246 |
+------------------------------+----------+
1 row in set (4.09 sec)
-- hideWikibase=0 ("Wikidata" shown) even though preference is to not show Wikidata
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 left join enwiki.user_properties on up_user=event_userId and up_property='rcshowwikidata' where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hideWikibase=0 and (up_value !='1' or up_value is null) group by event_enhancedFiltersEnabled;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 6 |
+------------------------------+----------+
1 row in set (7.66 sec)
-- hideWikibase=1 ("Wikidata" not shown) even though preference is to show Wikidata
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 left join enwiki.user_properties on up_user=event_userId and up_property='rcshowwikidata' where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hideWikibase=1 and up_value=1 group by event_enhancedFiltersEnabled;+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 69 |
+------------------------------+----------+
1 row in set (4.38 sec)
-- Edits by others/self:
-- hidemyself=1 ("Edits by others" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidemyself=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 61 |
| 1 | 116 |
+------------------------------+----------+
2 rows in set (5.22 sec)
-- hidebyothers=1 ("Edits by myself" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidebyothers=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 2 |
+------------------------------+----------+
1 row in set (3.72 sec)
-- Major/minor:
-- hideminor=1 ("Non-minor edits" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hideminor=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 67 |
| 1 | 229 |
+------------------------------+----------+
2 rows in set (3.80 sec)
-- hidemajor=1 ("Minor edits" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidemajor=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 1 |
+------------------------------+----------+
1 row in set (4.01 sec)
-- Bots/humans:
-- hidehumans=1 ("Bots" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidehumans=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 1 | 1 |
+------------------------------+----------+
1 row in set (3.81 sec)
-- hidebots=0 (both bots and humans; default state is "Humans only")
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidebots=0 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 38 |
| 1 | 2 |
+------------------------------+----------+
2 rows in set (7.50 sec)
-- hidepatrolled/hideunpatrolled and hideReviewed are N/A on enwiki
-- User registration:
-- hideliu=1 ("Unregistered users" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hideliu=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 3675 |
| 1 | 1909 |
+------------------------------+----------+
2 rows in set (6.16 sec)
-- hideanon=1 ("Registered users" only)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hideanons=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 57 |
| 1 | 30 |
+------------------------------+----------+
2 rows in set (7.47 sec)
-- User experience level: (note that registered/unregistered moved into this group on 7/28)
mysql:research@s3-analytics-slave [log]> select event_userExpLevel, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' group by event_userExpLevel ;
+-----------------------------------+----------+
| event_userExpLevel | count(*) |
+-----------------------------------+----------+
| NULL | 115037 | -- No selection made
| experienced | 45 |
| learner | 12 |
| learner;experienced | 2 |
| newcomer | 158 |
| newcomer;learner | 3817 |
| registered | 6 |
| registered;experienced | 5 |
| registered;newcomer | 1 |
| unregistered | 289 |
| unregistered;newcomer | 6 |
| unregistered;newcomer;experienced | 1 |
| unregistered;newcomer;learner | 96 |
| unregistered;registered | 1 |
+-----------------------------------+----------+
14 rows in set (8.80 sec)
-- ORES filters:
-- hidenondamaging=1 (old-style ORES filter)
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_hidenondamaging=1 group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 1291 |
| 1 | 1 | -- Probably a fluke
+------------------------------+----------+
2 rows in set (4.43 sec)
-- Damaging filters:
mysql:research@s3-analytics-slave [log]> select event_damaging, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' group by event_damaging ;
+------------------------------------+----------+
| event_damaging | count(*) |
+------------------------------------+----------+
| NULL | 110095 | -- No selection made
| all | 20 |
| likelybad | 732 |
| likelybad;verylikelybad | 7138 |
| likelygood | 35 |
| likelygood;likelybad | 1 |
| likelygood;likelybad;verylikelybad | 2 |
| likelygood;maybebad | 7 |
| likelygood;maybebad;likelybad | 4 |
| likelygood;maybebad;verylikelybad | 2 |
| likelygood;verylikelybad | 2 |
| maybebad | 93 |
| maybebad;likelybad | 20 |
| maybebad;likelybad;verylikelybad | 189 |
| maybebad;verylikelybad | 21 |
| verylikelybad | 1114 |
| verylikelybad@liveupdate=1 | 1 | -- User error :)
+------------------------------------+----------+
17 rows in set (7.38 sec)
-- Good faith filters:
mysql:research@s3-analytics-slave [log]> select event_goodfaith, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' group by event_goodfaith ;
+----------------------------------+----------+
| event_goodfaith | count(*) |
+----------------------------------+----------+
| NULL | 111642 | -- No selection made
| all | 5 |
| likelybad | 346 |
| likelybad;verylikelybad | 455 |
| likelygood | 33 |
| likelygood;maybebad | 5 |
| likelygood;maybebad;likelybad | 3 |
| maybebad | 119 |
| maybebad;likelybad | 11 |
| maybebad;likelybad;verylikelybad | 6702 |
| maybebad;verylikelybad | 23 |
| verylikelybad | 132 |
+----------------------------------+----------+
12 rows in set (7.32 sec)
-- Namespace filter:
-- Number of events where the namespace filter is set to anything at all:
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_namespace is not null and event_namespace != '' group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 1910 |
| 1 | 4960 |
+------------------------------+----------+
2 rows in set (3.70 sec)
-- Number of events for each specific namespace:
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, event_namespace, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' group by event_enhancedFiltersEnabled, event_namespace;
+------------------------------+-----------------+----------+
| event_enhancedFiltersEnabled | event_namespace | count(*) |
+------------------------------+-----------------+----------+ -- In non-beta:
| 0 | NULL | 83238 | -- no selection
| 0 | 0 | 1014 | -- (Article)
| 0 | 1 | 514 | -- Talk
| 0 | 2 | 22 | -- User
| 0 | 3 | 208 | -- User talk
| 0 | 4 | 272 | -- Wikipedia
| 0 | 5 | 2 | -- Wikipedia talk
| 0 | 6 | 41 | -- File
| 0 | 7 | 1 | -- File talk
| 0 | 8 | 48 | -- MediaWiki
| 0 | 9 | 21 | -- MediaWiki talk
| 0 | 10 | 8 | -- Template
| 0 | 11 | 1 | -- Template talk
| 0 | 12 | 331 | -- Help
| 0 | 14 | 14 | -- Template
| 0 | 100 | 330 | -- Portal
| 0 | 118 | 24 | -- Draft
| 0 | 711 | 1 | -- TimedText talk
| 0 | 828 | 60 | -- Module
| 0 | 829 | 12 | -- Module talk
| 1 | NULL | 27860 | -- In beta:
| 1 | 0 | 494 | -- (Article)
| 1 | 1 | 5 | -- Talk
| 1 | 2 | 4 | -- User
| 1 | 3 | 4866 | -- User talk [note: one user is responsible for 4861 of these within 6 hours, probably discovered live update and left it on]
| 1 | 4 | 7 | -- Wikipedia
| 1 | 5 | 12 | -- Wikipedia talk
| 1 | 6 | 9 | -- File
| 1 | 7 | 1 | -- File talk
| 1 | 8 | 23 | -- MediaWiki
| 1 | 10 | 12 | -- Template
| 1 | 12 | 9 | -- Help
| 1 | 100 | 9 | -- Portal
| 1 | 828 | 3 | -- Module
+------------------------------+-----------------+----------+
34 rows in set (4.18 sec)
-- Note that no uses of multiple namespace filters appear in the data
-- "Associated namespace" checkbox (disappeared from the beta halfway through):
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_associated is not null and event_associated != '' group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 660 |
| 1 | 19 |
+------------------------------+----------+
2 rows in set (6.36 sec)
-- Invert namespace selection:
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_invert is not null and event_invert != '' group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 3 |
| 1 | 6 |
+------------------------------+----------+
2 rows in set (7.72 sec)
-- Tag filter used:
-- Number of events where tag filter is used at all:
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, count(*) from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename='Recentchanges' and event_tagfilter is not null and event_tagfilter != '' group by event_enhancedFiltersEnabled ;
+------------------------------+----------+
| event_enhancedFiltersEnabled | count(*) |
+------------------------------+----------+
| 0 | 898 |
| 1 | 1427 |
+------------------------------+----------+
2 rows in set (4.12 sec)
-- Top 10 most popular tag filters overall:
mysql:research@s3-analytics-slave [log]> select event_tagfilter, count(*) as c from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' and event_tagfilter is not null group by event_tagfilter order by c desc limit 10;
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------+
| event_tagfilter | c |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------+
| Possible self promotion in userspace | 1084 |
| mobile edit | 152 |
| autobiography | 126 |
| bad external|large unwikified new article|new blank article|Rapid reverts|non-English content|nonsense characters|nowiki added|autobiography|possible libel or vandalism|coi-spam|Possible self promotion in userspace|userspace spam|Possible vandalism|references removed|removal of Category:Living People|possible link spam|repeating characters|reverting anti-vandal bot|Section blanking|shouting|removal of speedy deletion templates|very short new article|wikilinks removed | 110 | -- Probably live update too, 108 of these are in the same hour
| removal of speedy deletion templates | 84 |
| possible libel or vandalism | 82 |
| huggle | 41 |
| possible link spam | 40 |
| very short new article | 35 |
| blanking | 31 |
+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------+
10 rows in set (3.75 sec)
-- Top 20 broken out by beta/non-beta and tag filter:
mysql:research@s3-analytics-slave [log]> select event_enhancedFiltersEnabled, event_tagfilter, count(*) as c from ChangesListFilters_16837986 where wiki='enwiki' and timestamp between '20170717000000' and '20170730235959' and event_pagename ='Recentchanges' and event_tagfilter is not null group by event_enhancedFiltersEnabled, event_tagfilter order by c desc limit 20;
+------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+
| event_enhancedFiltersEnabled | event_tagfilter | c |
+------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+
| 1 | Possible self promotion in userspace | 913 |
| 0 | Possible self promotion in userspace | 171 |
| 0 | autobiography | 122 |
| 1 | bad external|large unwikified new article|new blank article|Rapid reverts|non-English content|nonsense characters|nowiki added|autobiography|possible libel or vandalism|coi-spam|Possible self promotion in userspace|userspace spam|Possible vandalism|references removed|removal of Category:Living People|possible link spam|repeating characters|reverting anti-vandal bot|Section blanking|shouting|removal of speedy deletion templates|very short new article|wikilinks removed | 110 | -- Probably live update
| 0 | mobile edit | 80 |
| 0 | possible libel or vandalism | 76 |
| 1 | mobile edit | 72 |
| 0 | removal of speedy deletion templates | 62 |
| 0 | possible link spam | 39 |
| 0 | very short new article | 33 |
| 0 | possible vandalism | 29 |
| 1 | removal of articles for deletion template | 26 |
| 0 | coi-spam | 25 |
| 0 | de-userfying | 25 |
| 0 | large unwikified new article | 24 |
| 0 | huggle | 24 |
| 1 | blanking | 23 |
| 1 | removal of speedy deletion templates | 22 |
| 1 | huggle | 17 |
| 1 | articles for deletion template removed | 17 |
+------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+
20 rows in set (3.76 sec)