In T195796, @Ladsgroup helped us understand how the draftquality model is being scored on pages. The current business rule is that draftquality is only scored on the first revision of a page:
For the New Pages Feed improvements work, we've decided that we prefer for the model to be scored on the latest revision of the page. That's because when pages are new, they can be improved quickly, either by the original author or a community collaborator. We want those latest changes to be reflected in model scores so that reviewers continue to prioritize review on drafts that need attention soonest.
Therefore, the user story for this task is:
- As a reviewer, I need the New Pages Feed to reflect the latest draftquality score for each page in the feed.
That said, we don't want to be scoring and storing scores for many irrelevant pages. The engineer who takes this task will first have to figure out an approach that will work. @Catrope recommended a hybrid approach in which we use the ORES API to score new revisions of pages that are in the PageTriage queue.