Page MenuHomePhabricator

App describing Spanish Wikipedia article "Cleopatra" as trending (due to default voice search test for Hello Google)
Open, MediumPublicBUG REPORT

Description

Steps to Reproduce: in the app, Spanish is describing cleopatra as trending. This is a default voice search test in spanish for hello google. It shouldnt be represented in the top articled for the week.

Actual Results:

Capture+_2020-12-23-15-23-43.png (2×1 px, 756 KB)

Expected Results:

Event Timeline

Reedy renamed this task from App describing cleopatra as trendinh on Spanish to App describing cleopatra as trending on Spanish.Dec 23 2020, 9:40 PM

Sounds like this is a test article whose readership is being artificially inflated by tests. (Presumably, those tests should not be included in reading stats.)

Not exactly sure which team this would lie with, so sending it upstream. Feel free to reassign further upstream if warranted.

Aklapper renamed this task from App describing cleopatra as trending on Spanish to App describing Spanish Wikipedia article "Cleopatra" as trending (due to default voice search test for Hello Google).Jan 5 2021, 4:21 PM
Aklapper added a project: Pageviews-Anomaly.

Not exactly sure which team this would lie with, so sending it upstream. Feel free to reassign further upstream if warranted.

Does "upstream" mean "Wikifeeds"?

It's the same in the general pageview stats on https://pageviews.toolforge.org/?project=es.wikipedia.org&platform=all-access&agent=user&redirects=0&range=latest-20&pages=Cleopatra|Sorteo_Extraordinario_de_Navidad|Colegio_de_San_Ildefonso_(Madrid) so not sure there's anything to do in Wikifeeds itself. :)

Screenshot from 2021-01-05 17-19-53.jpg (914×1 px, 180 KB)

Upstream meaning "Product Infrastructure for now", but knowing that the source of this is probably upstream from them. (But we didn't know where it ultimately lies - hence encouraging them to send it further upstream as necessary.)

Is there a way to figure out what are the articles used for testing? Maybe we can exclude them from wikifeeds. Other than that it doesn't look like an issue in the wikifeeds service level.

Just bumping to say that users are still seeing Cleopatra in their top read.

https://es.wikipedia.org/api/rest_v1/feed/featured/2021/04/23

MusikAnimal subscribed.

This is a bit icky because the traffic is in fact genuine, as opposed to a disruptive bot or intentional manipulation of pageviews data. When we see spikes in traffic, we look for an explanation, and here we have one. Thus removing Pageviews-Anomaly. I agree we should still hide the article from the most-viewed section of the app and other places where we advertise trending topics, but removing it from the actual /top results in AQS is questionable. That data should reflect reality.