Page MenuHomePhabricator

Fix ORES Special page
Closed, ResolvedPublicBUG REPORT

Description

Steps to replicate the issue (include links if applicable):
After deploying the latest changes for the thresholds from
the Special page of the ORES extension seems broken.

What happens?:

Nothing appears on the page (blank).

What should have happened instead?:
A table with the thresholds for some of the ORES models used by the current wiki should be shown.
(noting some as not all of them are shown on this page).

Software version (skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):

What we should get:

Screenshot 2023-09-01 at 8.38.54 AM.png (744×1 px, 104 KB)

But instead we get this blank page:

Screenshot 2023-09-01 at 8.39.03 AM.png (1×1 px, 51 KB)

Event Timeline

Change 955417 had a related patch set uploaded (by Ilias Sarantopoulos; author: Ilias Sarantopoulos):

[mediawiki/extensions/ORES@master] remove precision/recall from Special page

https://gerrit.wikimedia.org/r/955417

Since we have removed the ORES requests and we keep the threshold interval in the config, precision and recall don't exist anywhere.
My suggestion for the fix is to remove them and print the thresholds tables as seen in the image below (provided in the patch above). The special page is an easy and quick way to verify the value of the thresholds that are defined.

Screenshot 2023-09-07 at 7.15.34 AM.png (944×840 px, 116 KB)

If we want to output precision and recall values we will have to hardcode these values in the configuration as well.

For precision and recall, I think we should find a way to show it from an outside service. Doesn't LW provide that somehow?

For precision and recall, I think we should find a way to show it from an outside service. Doesn't LW provide that somehow?

No it doesn't. The reasoning behind not adding this feature is because this is something related only to revscoring models, which will be deprecated at some point.
At the moment I doubt if there is going to be such a user request in the future for other models. If there is one, we will evaluate adding such functionality for models.

Yeah makes sense. We could link to the model card or something like that in the special page. Anyway, off-topic :D

Change 955417 merged by jenkins-bot:

[mediawiki/extensions/ORES@master] remove precision/recall from Special page

https://gerrit.wikimedia.org/r/955417