Page MenuHomePhabricator

Implement distributed processing for ORES
Closed, ResolvedPublic

Description

Now that batching and caching have been implemented, the major performance bottleneck is CPU for extracting features. It looks like celery is an interesting option here. See https://meta.wikimedia.org/wiki/Research_talk:Revision_scoring_as_a_service#ORES_performance_improvements

Event Timeline

Halfak created this task.Jun 13 2015, 4:26 PM
Halfak raised the priority of this task from to Needs Triage.
Halfak updated the task description. (Show Details)
Halfak moved this task to Active on the Scoring-platform-team (Current) board.
Halfak added a subscriber: Halfak.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 13 2015, 4:26 PM
Halfak claimed this task.Jun 13 2015, 5:18 PM
Halfak triaged this task as Medium priority.
Halfak set Security to None.
Halfak moved this task from Active to Backlog on the Scoring-platform-team (Current) board.
Halfak closed this task as Resolved.Jul 25 2015, 4:44 PM