Page MenuHomePhabricator

Support (or not) the ORES batch scoring in Lift Wing
Closed, DeclinedPublic

Description

ORES provides batch processing since many users' use-cases involve the batch scoring of a large number of revisions. E.g. when using ORES to build work-lists for Wikipedia editors, it's common to include an article quality prediction. [1]

You can see it in ORES API spec in which the third parameter is "revids" - the revision IDs to score (split multiple ids with "|")
https://ores.wikimedia.org/v3/#!/scoring/get_v3_scores_context

For example, there is a request URL given two revids:
https://ores.wikimedia.org/v3/scores/enwiki?models=damaging&revids=1083325118%7C267233560

Do we want to support the ORES batch scoring in Lift Wing? It should be not difficult to implement it. :)

[1] https://www.mediawiki.org/wiki/Talk:ORES/Paper#Batch_processing

Related Objects

StatusSubtypeAssignedTask
ResolvedNone
DeclinedNone

Event Timeline

Based on discussions at the team meeting last week, there are a few things need to be investigated before we decide to support the batch scoring feature on Lift Wing:

  1. What communities or users are using or may need the batch scoring?
  2. Looking into how this was implemented in ORES. Are the request handled/processed in parallel?
  3. The document suggests the maximum number of score request in a batch is 50. What would it be in Lift Wing based on our new architecture and workload?
elukey subscribed.

For the moment, let's decline it. We can restart the work if there will be the need in the future.