Pageviews's title parameter is impossible to generate from wiki markup {melc}
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	Yurik
	Feb 16 2016, 6:23 AM

Description

Pageviews analytics seems to be using its own magical page format which is not possible to recreate from the wiki markup. I'm trying to create this template: https://en.wikipedia.org/wiki/Template:Graph:PageViews

For that, I need a {{{2|{{ARTICLEPAGENAME}}}}} (parameter #2 or the current page name) to be converted to the pageview's title.
This is not possible because:

{{urlencode:string|wiki}} does not escape /
{{urlencode:string|path}} does not convert spaces to _
There are no generic functions to convert title to "db-style" title with underscores
There are no functions to do search/replace

Please add support for %20 equivalence to _

Related Objects

Mentioned In: T131369: Pageviews API doesn't work for titles with % symbol.
T127487: WikimediaPageViewInfo doesn't handle titles with / in them properly

Event Timeline

Yurik created this task.Feb 16 2016, 6:23 AM

Yurik raised the priority of this task from to Needs Triage.

Yurik updated the task description. (Show Details)

Yurik added projects: Analytics, Pageviews-API.

Yurik added subscribers: Yurik, Milimetric.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptFeb 16 2016, 6:23 AM

Yurik added a subscriber: tstarling.Feb 16 2016, 6:24 AM

Try {{FULLPAGENAMEE:$2}}

Milimetric triaged this task as High priority.Feb 16 2016, 9:02 PM

Milimetric set Security to None.

agreed this is important, @Yurik, but we've got a big backlog

@Umherirrender - that will generate a URL that does not escape slashes.

{{#if: {{{2|}}} | {{FULLPAGENAMEE:{{{2}}}}} | {{ARTICLEPAGENAMEE}} }} with param 2 = Википедия:Форум/Технический produces this text, which you can see has a slash in it, thus breaking pageviews api request
%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F:%D0%A4%D0%BE%D1%80%D1%83%D0%BC/%D0%A2%D0%B5%D1%85%D0%BD%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B9

@Milimetric, we do not need to normalize any symbols other than the space. If you treat space and underscore as the same, it will all work great.

Milimetric claimed this task.Feb 17 2016, 5:00 PM

Milimetric edited projects, added Analytics-Kanban; removed Analytics.

Restricted Application added a project: Analytics. · View Herald TranscriptFeb 17 2016, 5:00 PM

Milimetric renamed this task from Pageviews's title parameter is impossible to generate from wiki markup to Pageviews's title parameter is impossible to generate from wiki markup {melc}.Feb 17 2016, 5:00 PM

I was looking here:

https://tools.wmflabs.org/pageviews#project=ru.wikipedia.org&pages={{FULLPAGENAMEE:Википедия:Форум/Технический}}

and that works for me (IE11 and FF42)
https://tools.wmflabs.org/pageviews#project=ru.wikipedia.org&pages=%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F:%D0%A4%D0%BE%D1%80%D1%83%D0%BC/%D0%A2%D0%B5%D1%85%D0%BD%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B9

Milimetric moved this task from Next Up to In Progress on the Analytics-Kanban board.Feb 18 2016, 4:05 PM

Change 271540 had a related patch set uploaded (by Milimetric):
Fix handling of encoded and spaced article titles

https://gerrit.wikimedia.org/r/271540

gerritbot added a project: Patch-For-Review.Feb 18 2016, 4:06 PM

Milimetric moved this task from In Progress to In Code Review on the Analytics-Kanban board.Feb 18 2016, 4:06 PM

Milimetric removed a project: Analytics.Feb 18 2016, 6:06 PM

Restricted Application added a project: Analytics. · View Herald TranscriptFeb 18 2016, 6:06 PM

Milimetric removed a project: Analytics.Feb 18 2016, 6:07 PM

Restricted Application added a project: Analytics. · View Herald TranscriptFeb 18 2016, 6:07 PM

Milimetric removed projects: Analytics, Pageviews-API.Feb 18 2016, 6:07 PM

I give up, Herald, you win, you persistent beautiful fool, you.

@Umherirrender, the basic problem is that if current article's name contains spaces, slashes, and non-latin characters, I have not found any way to convert it to the format required by analytics - a string with path-encoded slashes and non-latin chars, plus all spaces converted to underscores.

• Krassotkin subscribed.Feb 19 2016, 3:32 PM

Change 271540 merged by Milimetric:
Fix handling of encoded and spaced article titles

https://gerrit.wikimedia.org/r/271540

Legoktm mentioned this in T127487: WikimediaPageViewInfo doesn't handle titles with / in them properly.Feb 19 2016, 6:03 PM

Milimetric renamed this task from Pageviews's title parameter is impossible to generate from wiki markup {melc} to Pageviews's title parameter is impossible to generate from wiki markup {melc} [3 pts].Feb 22 2016, 5:39 PM

Milimetric renamed this task from Pageviews's title parameter is impossible to generate from wiki markup {melc} [3 pts] to Pageviews's title parameter is impossible to generate from wiki markup {melc}.Feb 22 2016, 8:54 PM

Milimetric moved this task from In Code Review to Done on the Analytics-Kanban board.

Milimetric set the point value for this task to 3.

Ok, @Yurik this is deployed now

Works, well done!

• Pchelolo mentioned this in T131369: Pageviews API doesn't work for titles with % symbol..Mar 31 2016, 4:22 PM

Pageviews's title parameter is impossible to generate from wiki markup {melc}Closed, ResolvedPublic3 Estimated Story PointsActions

Description

Related Objects

Event Timeline

Pageviews's title parameter is impossible to generate from wiki markup {melc}
Closed, ResolvedPublic3 Estimated Story Points
Actions