Page MenuHomePhabricator

Evaluate usage of the "Read as as wiki page" mobile talk page view
Closed, ResolvedPublic

Description

This task involves the work of evaluating how – if at all – the changes T309889 and T298222 introduced are impacting the way people use the "Read as wiki page" mobile talk page view.

Knowing the impact of these changes will help the Editing Team decide whether there are reasons for us to reevaluate doing what T280417 describes.

Open questions

  • 1) How has the number of visits (and if possible, visitors) to the Read as wiki page view changed over time?
  • 2) How has the number of taps (and if possible, number of people tapping) on the Read as wiki page link changed over time?
    • @DLynch noted in the Editing Team's 8 June 2022 meeting that engagement with this link is tracked in the MobileUIActions schema using the talkpage.readAsWiki event.
  • 3) What – if any – feedback have people shared with us about the Read as wiki page view/link?

Done

  • Answers to all ===Open question(s) are documented

Event Timeline

  • 1) How has the number of visits (and if possible, visitors) to the Read as wiki page view changed over time?
  • 2) How has the number of taps (and if possible, number of people tapping) on the Read as wiki page link changed over time?

I think visits and taps on the link are the same thing. Here's how the number of visits/taps changed over the last 90 days (we don't keep older data):

image.png (1×2 px, 65 KB)

select
  date(from_iso8601_timestamp(dt)) as t,
  count(*)
from mobilewebuiactionstracking
where event.action='click'
and event.name='talkpage.readAsWiki'
group by 1
order by 1

It clearly decreased after the DiscussionTools deployments, as expected from the fact that you have to scroll down now to access the button, but not nearly to zero.

[NOTE: The data is sampled, so the numbers on all of these charts don't represent the real number of actions]


The result is very similar when counting the people: (or as close as we can get to that, using the user tokens)

image.png (1×2 px, 65 KB)

select
  date(from_iso8601_timestamp(dt)) as t,
  count(distinct event.token)
from mobilewebuiactionstracking
where event.action='click'
and event.name='talkpage.readAsWiki'
group by 1
order by 1

I suppose it's notable that the number of taps and the number of users are very close. In other words, there seem to be very few users who use the link more than once. To be precise:

InteractionsUsers
1 interaction26343 (90%)
2+ interactions2971 (10%)
select
  if(n>1, '2+ interactions', '1 interaction') as "Interactions",
  count(*) as "Users"
from (
select
  event.token as token,
  count(*) as n
from mobilewebuiactionstracking
where event.action='click'
and event.name='talkpage.readAsWiki'
group by 1
order by 1
) x
group by 1
order by 1

It's also interesting that the number of users with 2+ interactions has dropped after the deployment. When comparing data before 2023-02-15 (first deployment) and after 2023-03-08 (final deployment):

InteractionsUsers
Before 2023-02-151 interaction10921 (88%)
Before 2023-02-152+ interactions1486 (12%)
After 2023-03-081 interaction9509 (91%)
After 2023-03-082+ interactions908 (9%)

(… and dt < '2023-02-15', … and dt > '2023-03-08')

Compared to the number of talk page visits, and other talk page interactions, the taps on "Read as wiki page" are uncommon:

Pre-deployment (1-14 February)Post-deployment (1-14 April)
Talk page visits54,00356,085
Taps to expand/collapse a topic23,72428,992
Taps to add a new topic1,3281,136
Taps to read as wiki page3,0671,968

(I had to limit these queries to short time ranges, do each query separately, and limit the results to sections that don't cross the midnight boundary, or they would never finish. Ugh.)

select count(*) as "Talk page visits"
from mobilewebuiactionstracking m1
where event.action='init' and event.name='ns=1'
and (year,month,day) >= (2023,2,1)
and (year,month,day) <= (2023,2,14)

select count(*) as "Taps to expand/collapse a topic"
from mobilewebuiactionstracking m1
where m1.event.action='click' and m1.event.name='talkpage.section'
and (year,month,day) >= (2023,2,1)
and (year,month,day) <= (2023,2,14)
and exists(
  select 1
  from mobilewebuiactionstracking m2
  where m2.event.action='init' and m2.event.name='ns=1'
  and m2.event.pageToken = m1.event.pageToken
  and m2.year = m1.year
  and m2.month = m1.month
  and m2.day = m1.day
)

select count(*) as "Taps to add a new topic"
from mobilewebuiactionstracking m1
where m1.event.action='click' and m1.event.name='talkpage.add-topic'
and (year,month,day) >= (2023,2,1)
and (year,month,day) <= (2023,2,14)
and exists(
  select 1
  from mobilewebuiactionstracking m2
  where m2.event.action='init' and m2.event.name='ns=1'
  and m2.event.pageToken = m1.event.pageToken
  and m2.year = m1.year
  and m2.month = m1.month
  and m2.day = m1.day
)

select count(*) as "Taps to read as wiki page"
from mobilewebuiactionstracking m1
where m1.event.action='click' and m1.event.name='talkpage.readAsWiki'
and (year,month,day) >= (2023,2,1)
and (year,month,day) <= (2023,2,14)
and exists(
  select 1
  from mobilewebuiactionstracking m2
  where m2.event.action='init' and m2.event.name='ns=1'
  and m2.event.pageToken = m1.event.pageToken
  and m2.year = m1.year
  and m2.month = m1.month
  and m2.day = m1.day
)
)