Page MenuHomePhabricator

Investigate a Hyperswitch frontend for ORES
Closed, DeclinedPublic

Description

We might want to replace our cache-only code paths with HyperSwitch, a lightweight microservice frontend built and maintained by Services . It's configured using Swagger spec files, which we already have for ORES. This allows us to decouple cache lookups from ORES and free up Python resources, helps us standardize our service for WMF purposes, and lets us experiment with backend architectures.

Event Timeline

Pchelolo subscribed.

I'm not particularly sure what do you mean and want to achieve. Putting ORES behind RESTBase without using storage (as a simple proxy) will not really free up any resourses on ORES side. Do you mean you want reads of pre-computed scores to not touch ORES at all?

If I understand this task correctly, it seems to be a duplicate of T107196: Set up revscoring entry points in RESTBase.

Thanks for mentioning this, it does look like nearly the same concept. I'm not familiar enough with RESTBase to give an opinion about whether that would be the right level for integration, but it's certainly worth more exploration. We're considering architectural changes to ORES which make it even more compatible with this approach, namely generating the scores as a decoupled, stream-based process and serving the API from a static, disk-based cache like Cassandra.

Do you mean you want reads of pre-computed scores to not touch ORES at all?

Yes, exactly that! It should be possible to migrate from on-demand scoring to a stream-based backend, by at first serving uncached requests using an internal API request to ORES, then later filling the cache with a complete set of scores for each wiki. Having a non-ORES frontend would give us more flexibility in managing this transition.

Harej triaged this task as Medium priority.Apr 3 2019, 5:10 AM
elukey subscribed.

We are moving to Lift Wing: https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing

I am closing old tasks related to ORES since it is being deprecated, please re-open if you feel that any work could be done on Lift Wing.