Request
The Problem
The ReviewStream feed is designed to encourage adoption of newcomer-friendly edit review features in popular antivandalism tools—while improving edit review overall. The new feed will have no effect, however, if it isn't adopted by these programs, so we want to work with the community to provide designs and technical assistance where necessary. But which tools should we focus our attention on? Which will have the biggest effect on newcomers and on the edit-review process generally? Where do we find the biggest bang for our buck?
To know where to put our efforts, it will be extremely helpful to know what tools are most popular and/or most productive. Because time is short and we know the edit research team is busy with a big project, we are happy to confer on ways we can whittle this job down so that we get enough data to make decisions without having this be a huge effort.
One is that we don't need to look at all possible tools. It's our belief that the following are probably the most relevant:
- Huggle
- RTRC
- STIki
- LiveRC
- Any others?
Furthermore, we don't need to have exact figures-- ballpark numbers will do, even if it turns out we can't get apples to apples comparisons.
What Figures Do We Want?
I suppose the most useful feature would be the number of edits (reverts, talk page messages left, Thank-yous....) completed during, say, a given month. Failing that, the number of users per tool?
The complication is that we'd ideally like to know this across the eight wikis that are in the initial target group. These are:
- English Wikipedia
- Persian Wikipedia
- Dutch Wikipedia
- Polish Wikipedia
- Portuguese Wikipedia
- Russian Wikipedia
- Turkish Wikipedia
- Wikidata
Deadline
This information would be most useful if we could get it by the beginning of the new year—say, the first week in January.
Response
Searching for additional tools
The hardest part of this request is knowing which tools we want to quantify the impact of; this depends more on local knowledge than on analytic skill.
Seven of the sites on the list are Wikipedias, so I went through the Wikipedia gadget report down to the 2 000 user mark. I didn't find any new ones used for edit review. I also checked the list of default gadgets on Wikipedias and didn't find any there either.
For the English Wikipedia, I reviewed the main list of counter-vandalism tools and checked views of their wiki pages for tools that looked like they could conceivably be active (I excluded Twinkle because it doesn't provide its own patrolling interface). Only Huggle, STiki, and Igloo had significant pageviews. The list of site gadgets didn't include anything related to patrolling.
For Wikidata, I reviewed its lists of external tools and of gadgets and didn't find anything used to patrol new edits. When I looked for thing tagged 'wikidata' in the tools directory, I found one thing: the reCH tool.
Huggle
Huggle is definitely used at the English Wikipedia. Comparing views to its wiki pages across languages, it's worth checking its use on the Russian, Portuguese, Persian, and Turkish, and Dutch Wikipedias too.
It's possible to check the number of Huggle installations by checking for pages like User:<user>/huggle3.css, but that's very time-consuming and is less useful than knowing the number of edits made.
Huggle uses a different edit comment string on each Wikipedia: [[WP:HG|HG]] on English, [[ВП:HG|HG]] on Russian, [[WP:H|Huggle]] on Portuguese , [[وپ:هاگ|هاگ]] on Persian, and [[Project:Huggle|HG]] on Turkish. Dutch seems to have no Huggle activity.
Searching for these strings, it was used to over the past 30 days to make the following:
- English Wikipedia: 60 405 edits
- Russian Wikipedia: 184 edits
- Portuguese Wikipedia: 5 591 edits
- Persian Wikipedia: 38 edits
- Turkish Wikipedia: 133 edits
RTRC
Combining data from the gadget report and the script link tool, RTRC has been installed by a significant number of users at the following wikis (note that many may be inactive):
- English Wikipedia: 5 246 users
- Persian Wikipedia: 481 users
- Turkish Wikipedia: 254 users
- Dutch Wikipedia: 144 users
- Polish Wikipedia: 88 users
RTRC doesn't use any edit tags or comment strings to mark edits, so there's no way to count them.
STiki
STiki is based at the English Wikipedia, where it includes [[WP:STiki|STiki]] in its edit comments. STiki has a page at the Portuguese Wikipedia, but that gets very few view and the tool wasn't mentioned in any edit comments during the past, so it's clearly not actively used there.
At the English Wikipedia, over the past 30 days, 52 different editors used it to make 23 447 edits.
LiveRC
LiveRC is based at the French Wikipedia (where it has an edit tag), but that's not in the group we're interested in. According to the gadget report, it has been installed by a number of users at the Polish Wikipedia (1 004 users) and Persian Wikipedia (541 users). Note that many of these users may be inactive.
As far as I can tell, neither of these Wikipedias has an edit tag or edit comment string which can be used to identify LiveRC edits.
reCH
reCH, which is a Wikidata-specific tool, tags its edits with OAuth CID: 408 (there's another tag for a previous version, but it wasn't used during the past 30 days). However, it's used for many things other than edit review, so to find reverts you also have to look for edits with the string undid. It can be used to patrol changes, but there's no way to attribute particular patrols to the tool.
Over the past 30 days, it was used to make 72 reverts.
Igloo
Igloo seems to be available on the English Wikipedia only, where it includes [[Wikipedia:Igloo|GLOO]] in its edit comments. Over the past 30 days, it was used to make 74 edits.
Queries used
select count(*) from enwiki.recentchanges where rc_comment like "%[[WP:HG|HG]]%"; count(*) 60405 --- select count(*) from ruwiki.recentchanges where rc_comment like "%[[ВП:HG|HG]]%"; count(*) 184 --- select count(*) from ptwiki.recentchanges where rc_comment like "%[[WP:H|Huggle]]%"; count(*) 5591 --- select count(*) from fawiki.recentchanges where rc_comment like "%[[وپ:هاگ|هاگ]]%"; count(*) 38 --- select count(*) from trwiki.recentchanges where rc_comment like "%[[Project:Huggle|HG]]%"; count(*) 133 --- select count(distinct rc_user) from enwiki.recentchanges where rc_comment like "%[[WP:STiki|STiki]]%"; count(distinct rc_user) 52 --- select count(*) from enwiki.recentchanges where rc_comment like "%[[WP:STiki|STiki]]%"; count(*) 23447 --- select count(*) from wikidatawiki.recentchanges inner join change_tag on rc_id = ct_rc_id where ct_tag = "OAuth CID: 408" and rc_comment like "%Undid%" count(*) 72 --- select count(*) from enwiki.recentchanges where rc_comment like "%[[Wikipedia:Igloo|GLOO]]%"; count(*) 74