Fit more topic models into ORES
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	Halfak
	Apr 6 2020, 5:07 PM

Description

ORES has memory limits. There are various things we can do to fit more topic models in. This is an epic task to gather those various strategies.

Status	Assigned	Task
Resolved	Trizek-WMF	T247507 Scale: deploy Growth features to 100 wikis
Open	None	T249383 Scale: ORES topic models for fr, pt, pl, fa, sv, da, it, id, he (needed for May 2020)
Open	None	T252599 Build article topic model for Swedish Wikipedia
Resolved	Halfak	T278723 ORES deployment - Spring 2021
Resolved	HAKSOAT	T249382 Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available)
Declined	None	T249520 Fit more topic models into ORES
Resolved	Pavol86	T247523 Compress Gensim models
Resolved	Halfak	T242705 ORES uwsgi consumes a large amount of memory and CPU when shutting down (as part of a restart)

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 6 2020, 5:07 PM

Halfak triaged this task as Medium priority.Apr 6 2020, 5:10 PM

Halfak moved this task from Unsorted to Epic on the Machine-Learning-Team board.

The ML team is focusing on https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing, the replacement of ORES. Please re-open if you feel that something is missing, but we'd prefer to add any new functionality only on Lift Wing.