Page MenuHomePhabricator
Create Task
Maniphest T353438

What actions do users take on Special:Diff and Special:MobileDiff?
Closed, ResolvedPublic
Actions

Description

In July 2023 we instrumented some data collection on Special:Diff and Special:MobileDiff (T326212). Because our team pivoted to another project, we ended up not needing this data. Since then, however, the iOS team and @Jdlrobson have been doing some related work, and would find a surface-level analysis of the data we've collected so far valuable.

We plan to remove the instrumentation collecting this data (T353366).

Questions

  • Which links do users interact with on Special:Diff?
  • Which links do users interact with on Special:MobileDiff?
  • Are these interaction rates different for new users vs experienced users?

Related Objects

Event Timeline

Samwalton9-WMF created this task.Dec 14 2023, 12:00 PM
Samwalton9-WMF edited subscribers, added: KCVelaga_WMF; removed: KCVelaga.

@Jdlrobson also suggested the following question:

What do people that switch to the desktop view diff do after they’ve made the switch?

We separately set up logging for users using the 'switch to desktop' mobile link (T310852). @KCVelaga_WMF is it possible that we could combine these data sources to understand what someone does after switching to desktop?

KCVelaga_WMF claimed this task.Jan 9 2024, 11:32 AM
KCVelaga_WMF edited projects, added Product-Analytics (Kanban); removed Product-Analytics.
Samwalton9-WMF mentioned this in T353366: Remove WikimediaEvents diff instrumentation.Jan 9 2024, 11:55 AM
mpopov triaged this task as Medium priority.Jan 10 2024, 1:54 AM
KCVelaga_WMF moved this task from Next 2 weeks to Needs Review on the Product-Analytics (Kanban) board.EditedMar 6 2024, 5:47 PM
KCVelaga_WMF added a subscriber: mpopov.

@Samwalton9-WMF

Here are the results from the initial analysis.

  • The last event was logged on 23 January 2024.
  • In the preceding 90 days, 2556072 events were logged.

Number events by platform
majority of the usage was on desktop

platformcountpercentage
desktop_browser198717478%
mobile_browser56889822%

Number of events by logged-in vs. anonymous users
majority of the usage was by registered users

is_logged_incount
True1648816
False907256

Number events by edit bucket
majority of the usage was by more experienced users

edit_count_bucketcount
1000+ edits1413665
100-999 edits137462
5-99 edits65826
1-4 edits20290
0 edits11573

Top 5 actions on desktop

actioncount
next_link853754
prev_link415824
view_history274076
user_link121142
undo102261

Actions on mobile
only two actions were logged)

actioncount
next_link336849
prev_link232049

Top five actions by edit bucket
no much variation of top actions by newcomers vs. experienced users

action1000+ edits100-999 edits5-99 edits1-4 edits0 edits
next_link577440668303223684265954
prev_link278967379331934068033747
view_history2032591539662931926695
undo8736347772248--
user_link84081544627511258555
contribs---706302

Here is a full list of frequency of actions taken

P58584 Frequency of actions taken on Special:Diff and Special:MobileDiff
1| action | count |
2|-------------------------------------------------------------|-----------------|
3| next_link | 1190603 |
4| prev_link | 647873 |
5| view_history | 274076 |
6| user_link | 121142 |
7| undo | 102261 |
8| contribs | 95851 |
9| rollback | 58121 |
10| thank | 29524 |
11| watchlist | 27485 |
12| change_visibility | 3561 |
13| mw-tag-marker-visualeditor | 1905 |
14| tags | 1344 |
15| mw-tag-marker-mw-undo | 377 |
16| mw-tag-marker-discussiontools-reply | 204 |
17| mw-tag-marker-mw-rollback | 182 |
18| mw-tag-marker-visualeditor-wikitext | 173 |
19| mw-tag-marker-visualeditor-switched | 167 |
20| mw-tag-marker-twinkle | 165 |
21| mw-tag-marker-mw-manual-revert | 130 |
22| mw-tag-marker-discussiontools-newtopic | 112 |
23| mw-tag-marker-AWB | 97 |
24| mw-tag-marker-huggle | 70 |
25| mw-tag-marker-disambiguator-link-added | 44 |
26| mw-tag-marker-LiveRC | 39 |
27| mw-tag-marker-newcomer_task | 31 |
28| mw-tag-marker-mobile_web_edit | 28 |
29| mw-tag-marker-AntiVandal_script | 23 |
30| mw-tag-marker-Twinkle | 23 |
31| mw-tag-marker-WPCleaner | 22 |
32| mw-tag-marker-possible_libel_or_vandalism | 20 |
33| mw-tag-marker-RedWarn | 18 |
34| mw-tag-marker-shortdesc_helper | 17 |
35| mw-tag-marker-newcomer_task_copyedit | 17 |
36| mw-tag-marker-newcomer_task_add_link | 16 |
37| mw-tag-marker-Ultraviolet | 15 |
38| mw-tag-marker-canned_edit_summary | 15 |
39| mw-tag-marker-OAuth_CID_5481 | 14 |
40| mw-tag-marker-OAuth_CID_1805 | 14 |
41| mw-tag-marker-OAuth_CID_1776 | 14 |
42| mw-tag-marker-OAuth_CID_6365 | 14 |
43| mw-tag-marker-mobile_edit | 12 |
44| mw-tag-marker-HotCat | 12 |
45| mw-tag-marker-OAuth_CID_4664 | 11 |
46| mw-tag-marker-BotSDC | 10 |
47| mw-tag-marker-convenient-discussions | 10 |
48| mw-tag-marker-parliamentedit | 9 |
49| mw-tag-marker-MassProtect | 9 |
50| mw-tag-marker-OAuth_CID_1742 | 8 |
51| mw-tag-marker-דיונים_נוחים | 7 |
52| mw-tag-marker-przeniesienie_do_brudnopisu | 7 |
53| mw-tag-marker-deprecated_source | 7 |
54| mw-tag-marker-BandeauxPortails | 6 |
55| mw-tag-marker-ProveIt_edit | 6 |
56| mw-tag-marker-VandalCleaner | 6 |
57| mw-tag-marker-OAuth_CID_1841 | 5 |
58| mw-tag-marker-疑似违反两岸用语方针 | 5 |
59| mw-tag-marker-OAuth_CID_1804 | 5 |
60| mw-tag-marker-Cat-a-lot | 5 |
61| mw-tag-marker-Adiutor | 4 |
62| mw-tag-marker-editProtectedHelper | 4 |
63| mw-tag-marker-HotCats | 4 |
64| mw-tag-marker-wulgaryzmy | 4 |
65| mw-tag-marker-WikibaseJS-cli | 4 |
66| mw-tag-marker-blockNotificationButton | 4 |
67| mw-tag-marker-mobile_app_edit | 4 |
68| mw-tag-marker-self-published-blog | 4 |
69| mw-tag-marker-מילים_בעייתיות | 3 |
70| mw-tag-marker-WT_NORM | 3 |
71| mw-tag-marker-בקשות_ממפעילים | 3 |
72| mw-tag-marker-PaStec | 3 |
73| mw-tag-marker-MassRollback | 3 |
74| mw-tag-marker-gadget-moveclaim | 3 |
75| mw-tag-marker-talk_banner_shell_conversion | 3 |
76| mw-tag-marker-fast-buttons | 3 |
77| mw-tag-marker-newcomer_task_links | 3 |
78| mw-tag-marker-usuwanie_tekstu | 3 |
79| mw-tag-marker-OAuth_CID_1779 | 2 |
80| mw-tag-marker-possible_BLPCRIME_issue | 2 |
81| mw-tag-marker-contenttranslation | 2 |
82| mw-tag-marker-self-published_source | 2 |
83| mw-tag-marker-newcomer_task_image_suggestion | 2 |
84| mw-tag-marker-possible_MOS_ETHNICITY_violation | 2 |
85| mw-tag-marker-OAuth_CID_1798 | 2 |
86| mw-tag-marker-WikiMirror | 2 |
87| mw-tag-marker-newcomer_task_section_image_suggestion | 2 |
88| mw-tag-marker-contenttranslation-v2 | 2 |
89| mw-tag-marker-OAuth_CID_1739 | 2 |
90| mw-tag-marker-rater | 1 |
91| mw-tag-marker-OAuth_CID_429 | 1 |
92| mw-tag-marker-OAuth_CID_1703 | 1 |
93| mw-tag-marker-patrol_required | 1 |
94| mw-tag-marker-ProveIt_편집 | 1 |
95| mw-tag-marker-diff-tools | 1 |
96| mw-tag-marker-OAuth_CID_4978 | 1 |
97| mw-tag-marker-congressedits | 1 |
98| mw-tag-marker-OAuth_CID_1784 | 1 |
99| mw-tag-marker-admin_bot | 1 |
100| mw-tag-marker-Inserção_de_fonte_possivelmente_não_confiável | 1 |
101| mw-tag-marker-OAuth_CID_1277 | 1 |
102| mw-tag-marker-OAuth_CID_1857 | 1 |
103| mw-tag-marker-VisualFileChange | 1 |
104| mw-tag-marker-WE-Framework_gadget | 1 |
105| mw-tag-marker-OAuth_CID_1232 | 1 |
106| mw-tag-marker-wikilove | 1 |
107| mw-tag-marker-ACDC | 1 |
108| mw-tag-marker-fa-ga-change | 1 |
109| mw-tag-marker-quick_linker | 1 |
110| mw-tag-marker-疑似COVID-19命名破坏 | 1 |
111| mw-tag-marker-mentorship_module_question | 1 |
112| mw-tag-marker-הצבעה | 1 |
113| mw-tag-marker-C-helper | 1 |
114| mw-tag-marker-OAuth_CID_1024 | 1 |
115| mw-tag-marker-iwrm | 1 |
116| mw-tag-marker-IMPARTIAL | 1 |
117| mw-tag-marker-deprecated_markup | 1 |
118| mw-tag-marker-RenommageCategorie | 1 |
119| mw-tag-marker-OAuth_CID_678 | 1 |
120| mw-tag-marker-pagetriage | 1 |
121| mw-tag-marker-OAuth_CID_1351 | 1 |
122| mw-tag-marker-OAuth_CID_359 | 1 |
123| mw-tag-marker-OAuth_CID_843 | 1 |
124| mw-tag-marker-contentious_topics_alert | 1 |
125| spam | 1 |
126| mw-tag-marker-wikidata-for-firefox | 1 |
127| mw-tag-marker-gadget-merge | 1 |
128| mw-tag-marker-RenameLink | 1 |
129| mw-tag-marker-newcomer_task_expand | 1 |
130| mw-tag-marker-Citing_predatory_open_access_journal | 1 |

About the following question

We separately set up logging for users using the 'switch to desktop' mobile link (T310852). @KCVelaga_WMF is it possible that we could combine these data sources to understand what someone does after switching to desktop?

I couldn't find the event logs for switch to desktop, and spoke to @mpopov. I will defer to him to clarify on that.

Samwalton9-WMF added a comment.Mar 6 2024, 6:39 PM

@Jdlrobson Please see above for some surface-level analysis on diff actions, as we discussed a little while back.

Samwalton9-WMF added a comment.Mar 7 2024, 9:46 AM

It looks like we missed Thank data on MobileDiff for reasons unclear.

Also, we identified that switch to desktop was only ever enabled on Beta, which I wasn't aware of, so we have no useful data there.

Jdlrobson added a subscriber: VirginiaPoundstone.Mar 14 2024, 6:22 PM

Ack. There's nothing here that I can use for the switch of the diff page on mobile, but looking at the edits hourly data seems promising!

Side note: @VirginiaPoundstone I see no reason to move ahead with turning off the schema and associated code.

Jdlrobson closed this task as Resolved.Mar 19 2024, 12:00 AM

Assuming this can be closed. Please reopen Sam if anything missing.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits