Maniphest T102345

Implement distributed processing for ORES
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Halfak
	Jun 13 2015, 4:26 PM

Tags

Referenced Files

None

Subscribers

Description

Now that batching and caching have been implemented, the major performance bottleneck is CPU for extracting features. It looks like celery is an interesting option here. See https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service#ORES_performance_improvements

Event Timeline

Halfak created this task.Jun 13 2015, 4:26 PM

Halfak raised the priority of this task from to Needs Triage.

Halfak updated the task description. (Show Details)

Halfak added a project: Machine-Learning-Team (Active Tasks).

Halfak moved this task to Parked on the Machine-Learning-Team (Active Tasks) board.

Halfak subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 13 2015, 4:26 PM

Halfak claimed this task.Jun 13 2015, 5:18 PM

Halfak triaged this task as Medium priority.

Halfak set Security to None.

Halfak moved this task from Parked to Backlog on the Machine-Learning-Team (Active Tasks) board.

https://github.com/wiki-ai/ores/pull/57

Halfak moved this task from Backlog to Completed on the Machine-Learning-Team (Active Tasks) board.Jul 24 2015, 4:03 PM

Halfak closed this task as Resolved.Jul 25 2015, 4:44 PM