Train/test copyvio detection model for text
Open, MediumPublic
Actions

Assigned To

None

Authored By

	Halfak
	Apr 1 2016, 12:18 PM

Description

Edits: tools.wmflabs.org/eranbot/edits_eranbot.pkl

Looks like we need to generate a list of edits that were saved while the bot was online.

See https://gist.github.com/eranroz/88f7dd4c568a764fb8150375942b2223 for a query to get these revisions

Related Objects
Search...

Status	Subtype	Assigned	Task
Open		None	T131481 Train/test copyvio detection model for text
Open	Spike	None	T102344 [Spike] Explore how we could train models on suppressed and revdeleted content
Open		None	T209960 Allow privileged users to label deleted revision in Wikilabels

Event Timeline

Halfak created this task.Apr 1 2016, 12:18 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 1 2016, 12:18 PM

I added login capabilities to the feature extractor so that we can process suppressed text. https://github.com/wiki-ai/revscoring/pull/256

Halfak moved this task from Parked to Backlog on the Machine-Learning-Team (Active Tasks) board.Apr 2 2016, 8:23 PM

Halfak updated the task description. (Show Details)Apr 3 2016, 8:11 AM

OK. I have a dataset with 10 million edits from the live timeperiods of the copyvio bot. next step is to produce a labeled dataset and try to see if we can train something with fitness. I think we'll need to sample the "false" observations.

Halfak moved this task from Backlog to Parked on the Machine-Learning-Team (Active Tasks) board.Apr 5 2016, 6:03 PM

Ladsgroup edited projects, added Machine-Learning-Team; removed Machine-Learning-Team (Active Tasks).Apr 18 2016, 3:11 PM

Ladsgroup moved this task from Unsorted to New development on the Machine-Learning-Team board.Apr 18 2016, 4:27 PM

Ladsgroup moved this task from New development to Ideas on the Machine-Learning-Team board.

The new CopyPatrol tool is slowly building up a dataset of manually confirmed copyright violations. If this is useful for training, let me know.

Halfak triaged this task as Medium priority.Aug 4 2016, 2:32 PM

Halfak added a subtask: T102344: [Spike] Explore how we could train models on suppressed and revdeleted content.Aug 4 2016, 2:48 PM

Halfak mentioned this in Unknown Object (Task).Sep 6 2016, 6:42 PM

Halfak moved this task from Ideas to Research & analysis on the Machine-Learning-Team board.Sep 22 2016, 2:54 PM

Halfak moved this task from Research & analysis to Ideas on the Machine-Learning-Team board.Sep 22 2016, 3:00 PM

Halfak mentioned this in Unknown Object (Task).Dec 14 2016, 10:55 PM

Halfak added a project: artificial-intelligence.Jan 20 2017, 8:39 PM