Page MenuHomePhabricator

Userviews/Massviews halts if PageViews API fails
Closed, ResolvedPublic

Description

I created a page today so the PageViews API does not have any stats for it yet.
When I run the Userviews tool it progresses to the point where the new page throws an error "Error querying Pageviews API - Not found." and halts. Ideally the tool should skip and continue.

This is with reference to http://tools.wmflabs.org/userviews/

Event Timeline

@Shyamal I just ran it at http://tools.wmflabs.org/userviews/?project=en.wikipedia.org&platform=all-access&agent=user&namespace=0&redirects=0&range=latest-20&sort=views&direction=1&view=list&user=Shyamal and it worked for me, and I still see "Sidney Gerald Burrard: Error querying Pageviews API - Not found.". So I don't it's the new page that broke it.

I have on occasion had this tool lock up and never finish for users who have created a ton of pages (kudos, by the way!), but I don't seem to be able to reliably reproduce the issue. For starters, let me know if it's working for you now. If it isn't, and you don't mind, please follow the steps at Wikipedia:Reporting JavaScript errors so we can get a better idea of what's going wrong. Thanks

@MusikAnimal Yes, your query works. Perhaps as you say the issue is with bigger queries. I was using a 1 year time period which I have retried and it seems to get stuck presumably due to memory issues. (stops at "Processing page 1242 of 1414").

It still worked for me when querying for the last 365 days http://tools.wmflabs.org/userviews/?project=en.wikipedia.org&platform=all-access&agent=user&namespace=0&redirects=0&range=latest-365&sort=views&direction=1&view=list&user=Shyamal

Memory consumption happens clientside, so there's a possibility your browser/computer just can't handle it. I have my doubts because 1,414 is not that many pages. Many people regularly use Massviews to query for up to 50,000 pages and have no problems.

Here's a Massviews query that involves around the same number of pages, see if that works, just as a comparison: http://tools.wmflabs.org/massviews/?platform=all-access&agent=user&source=category&target=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FCategory%3AMusicians_from_New_Jersey&range=latest-20&subjectpage=0&subcategories=1&sort=views&direction=1&view=list

If the above does work, than our issue I think might still be isolated to Userviews.

Userviews worked for 365 days quite reasonably and without any warnings/error messages today. The massviews link you gave worked even faster.

I can confirm a regression in the Massviews tool. You can easily reproduce the problem by setting range = latest-1. The tool will stop when "processing page X of Y", where Y−X are the number of pages with no stats. Note that when a page has no stats, that is, zero pageviews for the given range, the API returns a 404 error.

Fuzzy renamed this task from Userviews halts if PageViews API fails to Userviews/Massviews halts if PageViews API fails.Oct 26 2017, 3:38 PM

@Fuzzy This is because of T179113, which is new. The issue Shyamal experienced I think is still legitimate, but unrelated.

@MusikAnimal, I think you can close this task as T179113/T182103 are resolved.

MusikAnimal claimed this task.
MusikAnimal moved this task from Backlog to Done on the Tool-Pageviews board.

I do recall people complaining about this bug well before T179113/T182103 happened, but I've gotten no recent complaints, so I shall close this. Thanks.