Per discussion on the Analytics mailing list, would it be possible for the students to publish their Project Planning Document on Commons under a CC-BY or CC-BY-SA license?

If it's text, might Wikisource work as well? According to https://commons.wikimedia.org/wiki/Commons:Project_scope, text should be used in Commons only if it's in form of text files that are of use to other Wikimedia Projects.

In T120497#1994930, @Pine wrote:

Per discussion on the Analytics mailing list, would it be possible for the students to publish their Project Planning Document on Commons under a CC-BY or CC-BY-SA license?

We would be glad to release our Project Planning Document under CC BY-SA, but since it is a part of our grade, we need to check with our course supervisor first. Most likely, he will have no problem with it, we just have to make sure.
Fun seeing so much interest in our doings!

In T120497#1995046, @JEumerus wrote:

If it's text, might Wikisource work as well? According to https://commons.wikimedia.org/wiki/Commons:Project_scope, text should be used in Commons only if it's in form of text files that are of use to other Wikimedia Projects.

The document is a more or less our analysis of the project, risks, our project plan and stuff, a pdf consisting mostly of text but a couple of images.
Commons seems like the better choice to me.

Hey all, discovered that @MusikAnimal has been working on the demo API to make it more functional: https://tools.wmflabs.org/musikanimal/pageviews Might want to piggy back on that, rather creating a whole new interface, etc.

Indeed. I thought you all were close to finishing the native interface? T125917 My fork of marcelrf's app just adds history push states so it can support deep linking (the pop states I didn't finish... but not important). I also changed it to use Opensearch so you can query for redirect pages. Finally, I'm going to change the project selector to an input field so it will work on all WMF wikis, but I also want to add some validations to it.

FYI my work here was sloppily put together just to get something out that people can use. I don't think it works in some older browsers, and isn't really meant to be a long-term solution.

Indeed. I thought you all were close to finishing the native interface?

FYI that analytics team is not working on this near term.

My fork of marcelrf's app just adds history push states so it can support deep linking (the pop states I didn't finish... but not important).

Sure, our showcase app is not a tool but a means for people to copy code and get something working with API as soon as possible so forks welcome!

I don't think it works in some older browsers,

Well if it uses the history APi it doesn't work in many browsers (not saying that is an issue): http://caniuse.com/#search=history

@Nuria I can add in code to skip push/pop states if it's not supported. That's easy to do, but I don't plan on putting much more effort into supporting old IEs. After all, Microsoft doesn't support them either! :)

I have cross-wiki support working now. I just want to validate the input against the site matrix, as a dropdown would be far too long to have an entry for every WMF wiki. I also threw in some meta tags to make the app more mobile-friendly. Finally, fix the pop state bug... Basically it pushes, but when you hit the browser Back button, the view isn't updated. There are some conflicting event listeners that need to be ironed out.

In T120497#1995233, @Egedda wrote:

In T120497#1994930, @Pine wrote:

Per discussion on the Analytics mailing list, would it be possible for the students to publish their Project Planning Document on Commons under a CC-BY or CC-BY-SA license?

We would be glad to release our Project Planning Document under CC BY-SA, but since it is a part of our grade, we need to check with our course supervisor first. Most likely, he will have no problem with it, we just have to make sure.
Fun seeing so much interest in our doings!

In T120497#1995046, @JEumerus wrote:

If it's text, might Wikisource work as well? According to https://commons.wikimedia.org/wiki/Commons:Project_scope, text should be used in Commons only if it's in form of text files that are of use to other Wikimedia Projects.

The document is a more or less our analysis of the project, risks, our project plan and stuff, a pdf consisting mostly of text but a couple of images.
Commons seems like the better choice to me.

Thank you. If it's possible to do so and you're interested, it would also be great if you could present a lightning talk about this project on February 16th. Please see https://www.mediawiki.org/wiki/Lightning_Talks#February_2016. If you cannot attend at that time of day, perhaps you could record a talk that could be played during the meeting. Thanks!

@MusikAnimal

My fork of marcelrf's app just adds history push states so it can support deep linking (the pop states I didn't finish... but not important).

Sure, our showcase app is not a tool but a means for people to copy code and get something working with API as soon as possible so forks welcome!

Yes, Nuria is right. But anyway, your version of the demo is totally amazing!

@MusikAnimal
btw. It seems that there is code to strip www. from entry, but www.wikidata.org is the official url for wikidata, so it's currently very difficult to get stats for that project (you have to race the JS :) ).

Also @MusikAnimal, your tool doesn't seems to work in Safari here. The input field to select pages doesn't function.

@TheDJ Fixed, though I'm not able to actually get any data from the pageviews API. Are we sure wikidata is supported?

@Sjoerddebruin I am not able to reproduce. What version of Safari are you using, and under what operating system?

@mforns I believe you are the one I have to thank for sparking this effort! I would have not thought to use Select2 or even Bootstrap. I've longed shunned CSS libraries, but I'm sold now, thanks to you!

I had originally said this was not meant to a be a long-term solution, but I take that back. There are many more features coming!

In T120497#2009518, @MusikAnimal wrote:

@TheDJ Fixed, though I'm not able to actually get any data from the pageviews API. Are we sure wikidata is supported?

@Sjoerddebruin I am not able to reproduce. What version of Safari are you using, and under what operating system?

@mforns I believe you are the one I have to thank for sparking this effort! I would have not thought to use Select2 or even Bootstrap. I've longed shunned CSS libraries, but I'm sold now, thanks to you!

I had originally said this was not meant to a be a long-term solution, but I take that back. There are many more features coming!

Safari 9.0.1 on OS X 10.11.1. Javascript console says that the following file can't be found: https://tools.wmflabs.org/musikanimal/vendor/jquery.min.map But I think it has something to do with my adblocker.

Also, Wikidata should have pageviews AFAIK.

@Sjoerddebruin yes, there is an issue with ad blockers. I have no idea why, but there definitely aren't any ads :) I put a notice about this where the <canvas> is rendered, so that if the chart showed it would hide the notice. Did the chart load for you? That means some ad blockers are blocking different things... ugh. I'd like to know why this issue exists in the first place. I want to blame it on Tool Labs but am not sure :/

In T120497#2009528, @MusikAnimal wrote:

@Sjoerddebruin yes, there is an issue with ad blockers. I have no idea why, but there definitely aren't any ads :) I put a notice about this where the <canvas> is rendered, so that if the chart showed it would hide the notice. Did the chart load for you? That means some ad blockers are blocking different things... ugh. I'd like to know why this issue exists in the first place. I want to blame it on Tool Labs but am not sure :/

The chart also didn't work. I think it has something to do with HTTPS and the location of some files (CORS).

@Sjoerddebruin so you did see the notice, then? which ad blocker extension are you using? I've got to get to the bottom of this.

In T120497#2009583, @MusikAnimal wrote:

@Sjoerddebruin so you did see the notice, then? which ad blocker extension are you using? I've got to get to the bottom of this.

Currently using uBlock, until a good adblocker that supports the new content blocking API appears.

@Sjoerddebruin could you link me to the extension? Not seeing it at https://safari-extensions.apple.com/?q=ublock

In T120497#2009600, @MusikAnimal wrote:

@Sjoerddebruin could you link me to the extension? Not seeing it at https://safari-extensions.apple.com/?q=ublock

https://www.ublock.org

@MusikAnimal: Would you like some help tackling the issues at https://github.com/MusikAnimal/pageviews/issues?

@kaldari Sure! The only problem is I'm in the middle of a big cleanup. When this first started I just wanted to get something out that worked, now I'm trying to make this a manageable codebase for others to work on too. Glad to know someone is willing to help :)

Improve CSV format is one that is simple and unlikely to cause conflicts at this point, if you're up for that. I can share my plans for the larger features that will require interface changes. Maybe we can talk more on IRC.

@MusikAnimal: Cool, created T127143 so we can track it as part of Community Tech work.

@Egedda have you uploaded the Project Planning Document to Commons yet?

In T120497#2050120, @Pine wrote:

@Egedda have you uploaded the Project Planning Document to Commons yet?

We haven't gotten a response yet from our supervisor (which should've gotten last week, but hey, thats uni).
But we will be happy share our PPD as soon as our supervisor gets back to us, sorry for the delay.

Graph:PageViews template is now done, and can be inserted anywhere to show the pageviews of any wiki page on any site. For a demo, see US presidental candidates pageviews side by side

Yurik, this is awesome

@Yurik This looks great!

Is there any recommended way to get all article's pageviews on a daily/weekly basis?
or I can build my own solution by calling the stats API?

Thanks

Bianjang,

Daily and monthly aggregates are at https://dumps.wikimedia.org/other/pagecounts-ez/merged/

Erik

Thanks. Not sure if those dump will be affected by T114019?

Bianjiang, probably not. Dumps 2.0 is about database dumps, not traffic log dumps.

Erik

@Bianjiang: could you be more specific about what you're trying to accomplish? The pageview API provides access to project-level aggregates, per-article counts, and the top 1000 articles for each project on each day or month. So if I can get a more specific question I might be able to help or add a feature request.

@ezachte, your dataset (https://dumps.wikimedia.org/other/pagecounts-ez/) uses the old pageview definition, and thus is quite different from the new data. We'll be announcing the new pageview dataset on dumps soon, probably early next quarter (we're just backfilling so we have as much data as possible in there).

I guess @ezachte has answered my question, or maybe there are other options i was not aware of ...

my use case:
I build logic to extract various of things from an article, and the logic may fail on some articles while work on most of articles. when improving the logic, I'd like to use pageview of articles as a weight metric to help me focus on popular (more important) articles. So I need to have pageview for all articles.

So I need to have pageview for all articles.

You can get that from pageview API, please see docs: https://wikitech.wikimedia.org/wiki/Analytics/PageviewAPI

In T120497#2078609, @Bianjiang wrote:

my use case:
I build logic to extract various of things from an article, and the logic may fail on some articles while work on most of articles. when improving the logic, I'd like to use pageview of articles as a weight metric to help me focus on popular (more important) articles. So I need to have pageview for all articles.

@Bianjiang, I see now that I misunderstood. The dataset that @ezachte pointed out is the correct one.

In T120497#2080083, @Nuria wrote:

So I need to have pageview for all articles.

You can get that from pageview API, please see docs: https://wikitech.wikimedia.org/wiki/Analytics/PageviewAPI

For bulk data, the dumps are the better source. I was just confused about the status of which dataset is derived from which. We'll have to clean up the docs around that.

@Nuria depends on what @Biangjang meant: I thought separate counts for each article. That might work in theory, not in practice, for largest wikis, no? If combined total for all articles, then yes of course.

@Milimetric I updated https://dumps.wikimedia.org/other/pagecounts-ez/ sometime in December to use the newest pageview definition.

@ezachte oooh!!! I thought you did that but then I looked at the docs on the page and they still say they're a derivative of pagecounts-raw. Ok, I'll add that to my todo for cleaning up those docs. Thanks, I'll go edit my comment.

I was ging to update those docs, then I forgot. My bad.

Please consider to update this page too.
https://en.m.wikipedia.org/wiki/Wikipedia:Pageview_statistics

In T120497#2111233, @Nizil wrote:

Please consider to update this page too.
https://en.m.wikipedia.org/wiki/Wikipedia:Pageview_statistics

Hmm that page should probably be deleted, or completely rewritten. It seems devoted to stats.grok.se, when we wouldn't want it devoted to Pageviews Analysis, either. There are multiple tools out there, and more on the way.

I added {{Graph:PageViews}} to MediaWiki:Pageinfo-footer on Zh WP, see https://zh.wikipedia.org/wiki/MediaWiki:Pageinfo-footer

Example: https://zh.wikipedia.org/w/index.php?title=Wikipedia:首页&action=info&&uselang=zh

@Shizhao , please update your example link above - if someon's user interface is not "zh", they won't see it. The link should have &uselang=zh at the end.

In T120497#2126355, @Yurik wrote:

@Shizhao , please update your example link above - if someon's user interface is not "zh", they won't see it. The link should have &uselang=zh at the end.

fixed

Seems that this is already done: https://tools.wmflabs.org/pageviews/?project=en.wikipedia.org&platform=all-access&agent=user&start=2016-01-16&end=2016-02-14&pages=Zika_virus