Page MenuHomePhabricator

Research: How are bot edits different than human edits on Wikidata?
Open, Needs TriagePublic

Description

Story: For future strategy, we wonder how bot edits differ from human edits and how bots and humans work peacefully together (or not). I would like to be able to give a data based account on that. I can imagine to sample some items, weight items by their use and then either cluster edits and/or code them manually (like: correcting, linking, referencing…)

I imagine this is a bit vague to immediately start, so we would need to come up with a mutual understanding that both covers practical needs as well as what the data can give us.

Assumption: Possibly, bots and humans have some separate tasks and some they "collaborate". Also, it might be interesting to see if/how authors and bots are connected (as in @Halfak’s analysis/rebuttal to that bots-fight-bots paper).

Possible outcome: Plausible hypothesis/patterns supported by the content of the edits.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 15 2018, 11:02 AM

Relevant Research:

– Halfaker, Aaron, and John Riedl. “Bots and Cyborgs: Wikipedia’s Immune System.” Computer 45, no. 3 (2012): 79–82.
– Piscopo, 2017 (expert users use more expert tools, beginners use the standard UI)

@Hall1467 and I have been working on measuring how humans and bots drive the quality of Wikidata items differently. We're specifically looking at alignment between demand (views of articles that sitelinked from Wikidata) and production (edits to items). We don't have a draft yet, but it would be good to share an overview of our current results before anyone gets started on this so we can see if there's overlap. :)

Vvjjkkii renamed this task from Research: How are bot edits different than human edits on Wikidata? to nxcaaaaaaa.Jul 1 2018, 1:09 AM
Vvjjkkii removed GoranSMilovanovic as the assignee of this task.
Vvjjkkii triaged this task as High priority.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii edited subscribers, added: GoranSMilovanovic; removed: Aklapper.
CommunityTechBot renamed this task from nxcaaaaaaa to Research: How are bot edits different than human edits on Wikidata?.Jul 2 2018, 4:09 PM
CommunityTechBot assigned this task to GoranSMilovanovic.
CommunityTechBot raised the priority of this task from High to Needs Triage.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot edited subscribers, added: Aklapper; removed: GoranSMilovanovic.
Addshore moved this task from incoming to in progress on the Wikidata board.Oct 9 2018, 9:38 AM

@Lydia_Pintscher @Jan_Dittrich

This ticket is opened and assigned to me for two years already.

Please let me know if additional details are available and should we plan to proceed with this.

Thank you.

I'd still be interested in case resources are allocated to this.

As the Wikidata project tag was removed: Which project tag should this task have, so it can be found by people looking for tasks via projects? Thanks in advance.

@Aklapper I've added the WMDE analytics project tags.

@Jan_Dittrich

I'd still be interested in case resources are allocated to this.

Ok.

@Lydia_Pintscher What do you think?

Lydia_Pintscher removed GoranSMilovanovic as the assignee of this task.Nov 4 2020, 10:12 AM
Lydia_Pintscher added a project: Wikidata.
Lydia_Pintscher added a subscriber: GoranSMilovanovic.

I don't think it has priority compared to the other things we have on the table at the moment. (Still need to get back to you on remaining Qurator things 😬 )
Not sure why it was assigned directly. Removing.