ORES has memory limits. There are various things we can do to fit more topic models in. This is an epic task to gather those various strategies.
Description
Description
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | Trizek-WMF | T247507 Scale: deploy Growth features to 100 wikis | |||
Open | None | T249383 Scale: ORES topic models for fr, pt, pl, fa, sv, da, it, id, he (needed for May 2020) | |||
Open | None | T252599 Build article topic model for Swedish Wikipedia | |||
Resolved | Halfak | T278723 ORES deployment - Spring 2021 | |||
Resolved | HAKSOAT | T249382 Scale: ORES topic models for uk, hu, hy, eu, sr (needed as soon as available) | |||
Declined | None | T249520 Fit more topic models into ORES | |||
Resolved | Pavol86 | T247523 Compress Gensim models | |||
Resolved | Halfak | T242705 ORES uwsgi consumes a large amount of memory and CPU when shutting down (as part of a restart) |
Event Timeline
Comment Actions
The ML team is focusing on https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing, the replacement of ORES. Please re-open if you feel that something is missing, but we'd prefer to add any new functionality only on Lift Wing.