We would like to have view stats for ArticlePlaceholder (Special:AboutTopic/Q* and localized versions) in Grafana.
To get a better idea about usage patterns, being able to see data for a single wiki would be useful. Also it would be useful to differentiate between bot/ spiders and real users (especially for the future, where we plan to add placeholders to search engines).
Change 295896 had a related patch set uploaded (by Addshore):
Add WikidataArticlePlaceholderMetrics
@Lydia_Pintscher how exactly do you want the data split? So per wiki of course, but how about in regards to bots spiders and users. Do you just want 1 number combining bots & spirder and then a second number for users? Do we actually care about bots & spiders at all and could we then just have one number which is just for real users?
I think the split would be good to have so we can see if there is anything strange going on with spiders as well. But the most important number is actual users.
I may be really dumb asking this question (and perhaps in the context of this task), but why is Special:AboutTopic/* indexed?
"how about in regards to bots spiders and user"
Good-faith spiders who obey NOINDEX won't be showing up on this page, so my presumption, given the question is that NOINDEX is not being set on Special:AboutTopic. Is that true, and why (not)?
It doesn't look like Special:AboutTopic is in the robots file.
That question is probably best directed at @Lydia_Pintscher :)
The pages should be indexed by search engines. That is one of the biggest things we need to do with it in order to reach more readers for these small Wikipedias and then turn some of them into editors.
@Addshore: What's the status here? I can't see any (useful, non-testing) data in Graphite.
2 patches to get merged and then switched on!
I'm working with @JAllemandou to get them merged :)
Change 296407 had a related patch set uploaded (by Addshore):
Ooziefy Wikidata ArticlePlaceholder Spark job
All deployed.
Graph added at https://grafana-admin.wikimedia.org/dashboard/db/article-placeholder
Data is now being backfilled since the first day of the AP deployment.
So the patches worked and the graph exists however after some of the data filled in we realised that we were not taking into account namespace aliases in other languages.
So the data collected is far below the actual numbers.
Change 298717 had a related patch set uploaded (by Addshore):
Include the namespace for all pages
Change 298719 had a related patch set uploaded (by Addshore):
Include the resolved special page name for special pages
Change 298723 had a related patch set uploaded (by Addshore):
Ignore namespace when matching Special:AboutTopic
Change 298724 had a related patch set uploaded (by Addshore):
Use x_analytics header to match special ns for Special:AboutTopic
Change 298725 had a related patch set uploaded (by Addshore):
Use x_analytics header to match special page name
Change 298726 had a related patch set uploaded (by Addshore):
Use webrequest in wikidata/articleplaceholder_metrics
Change 298719 merged by jenkins-bot:
Include the resolved special page name for special pages
Change 298796 had a related patch set uploaded (by Addshore):
Include the namespace for all pages
Change 298797 had a related patch set uploaded (by Addshore):
Include the resolved special page name for special pages
Change 298797 merged by jenkins-bot:
Include the resolved special page name for special pages
Mentioned in SAL [2016-07-13T17:44:12Z] <legoktm@tin> Synchronized php-1.28.0-wmf.10/extensions/WikimediaEvents/WikimediaEventsHooks.php: Include the namespace for all pages & Include the resolved special page name for special pages - T138500 (duration: 00m 36s)
Change 298723 abandoned by Addshore:
Ignore namespace when matching Special:AboutTopic
Reason:
This will be a one off run to backfill data and thus does not need to be merged.
Change 298725 abandoned by Addshore:
Use x_analytics header to match special page name
Reason:
Included as part of https://gerrit.wikimedia.org/r/#/c/298724/
Change 298723 restored by Addshore:
Ignore namespace when matching Special:AboutTopic
So the older data has now been filled into https://grafana.wikimedia.org/dashboard/db/article-placeholder
(overwriting the incorrect stuff)
The 2 patches now just need to be merged and deployed to have this running regularly!
Change 298723 abandoned by Addshore:
Ignore namespace when matching Special:AboutTopic
Reason:
This has now been run
Change 298724 merged by Nuria:
Match title & ns using x_analytics header & get all agent_types
Change 300235 had a related patch set uploaded (by Addshore):
Query using webrequest_source in ArticlePlaceholder query
Change 300236 had a related patch set uploaded (by Addshore):
Fix pageview -> webrequest in articleplaceholder coordinator
Change 300235 merged by Joal:
Query using webrequest_source in ArticlePlaceholder query
Change 300248 had a related patch set uploaded (by Addshore):
Fix CastException in ArticlePlaceholderMetrics
Change 300236 merged by Joal:
Fix pageview -> webrequest in articleplaceholder coordinator
@Addshore Is it possible to see which specific page titles are being rendered within Special:AboutTopic at each wiki? I couldn't see how to do so in the dashboard but might have missed it.
To repeat from T132223#2290840 a few people want "A way to see the most-viewed titles, so that the local community can focus their creation/translation efforts in the places where they might have the most usefulness."
E.g. if https://eo.wikipedia.org/wiki/Speciala%C4%B5o:AboutTopic/Q300915 was consistently getting the most views out of all uses of Special:AboutTopic, then local editors could focus on writing that article.
@Quiddity It is possible, but not with what has been done to fulfil this ticket.
It also doesn't sound like the sort of data we want to be feeding into graphite / grafana.
It would be nice if the pageview API could provide a list of these?
Ok, I've reopened (and clarified the title of) T132223: Track pageviews of specific pages that are rendered with ArticlePlaceholders. Thanks!