Mojtabakd mentions in this message about a problem with ORES and fawiki.
Description
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | kevinbazira | T314302 ORES doesn't support fawiki family template | |||
Resolved | kevinbazira | T317531 Retrain fawiki articlequality model | |||
Resolved | kevinbazira | T319373 Deploy new fawiki articlequality model to ORES and LiftWing | |||
Resolved | kevinbazira | T322614 Update existing fawiki-articlequality isvc with new model on LiftWing |
Event Timeline
Thid is an example of ref-->sfn conversion which lowers the ORES score ---> https://fa.wikipedia.org/w/index.php?title=زوسیموس&diff=35130948&oldid=35130784&diffmode=source
ORES models are built using a library called revscoring. Based on the way revscoring processes wikitext using wikitext parsed features, both ref wikitext tags and sfn wikitext templates should be taken care of in this section that lists ref_tags and templates.
I run a quick test using the fawiki ediquality goodfaith model comparing revid 35130784 with 35130948 and below are the results:
- 35130784 with ref tag returns {'prediction': True, 'probability': {False: 0.13646938691972665, True: 0.8635306130802733}}
- 35130948 with sfn template returns {'prediction': True, 'probability': {False: 0.02206572256478212, True: 0.9779342774352179}}
There is a slight change in the probability figures but this didn't overturn the prediction.
Support for sfn templates was added to fawiki articlequality, the model was retrained (T317531), evaluated (T317531#8362584), and deployed (T319373) to ORES and LiftWing.
@Mojtaba-kd, please let us know in case this issue persists. Thanks!