Page MenuHomePhabricator
Create Task
Maniphest T188603

[Pages Created] Make output list downloadable
Closed, ResolvedPublic
Actions

Description

Two requests from a user on deWP:

A complete downloadable list in various formats, similar to PetScan's output list, would be helpful.
Format: HTML, CSV, TSV, Wiki, JSON, PagePile. This would be helpful because many people keep lists of their self-created articles and could use this to simply copy the list from Pages Created.

Bonus question: Can the numbering be reversed so that the list starts with the oldest article? Right now, nr. 1 is always the newest article.

XTools version: 3.1.42-433634f

Related Objects

Event Timeline

JStrodt_WMDE created this task.Mar 1 2018, 9:49 AM
MusikAnimal moved this task from Backlog to Working on the XTools board.Mar 1 2018, 4:15 PM
MusikAnimal subscribed.

Can do! I like the idea to export to PagePile. Indeed that could be very useful.

For JSON, consider the API endpoint at https://xtools.readthedocs.io/en/stable/api/user.html#pages-created. I can still add a link to this in the download options.

We can reverse the ordering and put the oldest article first, but I suspect not everyone will like that. Admins, for instance, may use the Pages Created tool to assess whether a user is eligible to be autopatrolled. For this they want to see the newest articles. We could add an option to change the sorting, though. I'll look into it!

MusikAnimal moved this task from Working to Pending deployment on the XTools board.Mar 2 2018, 12:17 AM

I've got this done and will deploy soon! I want to work on T165864 next and have it get deployed at the same time.

A heads up -- it seems we can only send so many page titles to the PagePile API, because it only accepts a GET request, and not a POST. So in other words, you can't export to PagePile if you have say, 100 or more pages. I have created an issue at https://bitbucket.org/magnusmanske/pagepile/issues/5/make-create_pile_with_data-accept-post

MusikAnimal closed this task as Resolved.Mar 2 2018, 6:07 PM
MusikAnimal claimed this task.
MusikAnimal moved this task from Pending deployment to Complete on the XTools board.

Now, at the top of the "Pages Created" section, there is a "Download" dropdown menu. This gives you links to download as Wikitext, PagePile, CSV, TSV, and JSON.

Let me again say that you may have problems with the PagePile export. This is because of https://bitbucket.org/magnusmanske/pagepile/issues/5/make-create_pile_with_data-accept-post. Hopefully they will fix it soon.

To view by the oldest page first, click on the "Date" column to sort ascending. If there is pagination (more than 1000 results), use the links at the bottom to browse to the last page. I don't want to change the ordering just yet, because I know some people like it the way it is. If enough people want the oldest pages first, then by all means we can change it :)

JStrodt_WMDE awarded a token.Mar 6 2018, 3:05 PM

Thank you, that's great!

Framawiki subscribed.EditedMar 13 2018, 9:10 PM
In T188603#4016164, @MusikAnimal wrote:

A heads up -- it seems we can only send so many page titles to the PagePile API, because it only accepts a GET request, and not a POST. So in other words, you can't export to PagePile if you have say, 100 or more pages. I have created an issue at https://bitbucket.org/magnusmanske/pagepile/issues/5/make-create_pile_with_data-accept-post

I'm surprised, I've many times exported a pretty big list of pages to pagepile from petscan without problems. The GET server limit appears to be quite high, at least enough for ~2000 pages. See for example this list of 1,939 pages on frwiki :
https://tools.wmflabs.org/pagepile/api.php?action=get_data&id=13778
See how it's used by petscan: https://bitbucket.org/magnusmanske/petscan/src/33006f826342738833b06540cf9f97eb660ece40/trenderer.cpp?at=master&fileviewer=file-view-default#trenderer.cpp-74
maybe it's enough to add that to xtools, at least until the tool accepts POST?

JStrodt_WMDE added a comment.Apr 20 2018, 8:21 AM

Hey there, there's a bug in the wikitext output, see T192629: Pages Created: Download as Wikitext only outputs first page.

MusikAnimal mentioned this in T193477: [Pages Created] Investigate URI too long error when exporting to PagePile.May 1 2018, 3:33 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits