Steps to replicate the issue (include links if applicable):
- Replace an old ORES V1 request by a V3 "equivalent", such as https://ores.wikimedia.org/v3/scores/ptwiki/60845189/articlequality
What happens?: The predicted article class is now a boolean instead of one of the strings that appear as keys for the probability dictionary:
{ "ptwiki": { "models": { "articlequality": { "version": "0.8.0" } }, "scores": { "60845189": { "articlequality": { "score": { "prediction": true, "probability": { "1": 0.6505766596726758, "2": 0.09876741829105372, "3": 0.0634780511261501, "4": 0.06104126161283134, "5": 0.0573997480745124, "6": 0.06873686122277664 } } } } } } }
What should have happened instead?: The predicted article class should be identical to one of the keys in the probability dictionary (the string "1" in the example, which is the key that maximizes the probability value):
...
"prediction": "1",
"probability": {
"1": 0.6505766596726758,
...Other information:
The problem does not happen when one of the other classes has the highest probability:
- "prediction": "2": https://ores.wikimedia.org/v3/scores/ptwiki/66497121/articlequality
- "prediction": "3": https://ores.wikimedia.org/v3/scores/ptwiki/66513703/articlequality
- "prediction": "4": https://ores.wikimedia.org/v3/scores/ptwiki/66078571/articlequality
- "prediction": "5": https://ores.wikimedia.org/v3/scores/ptwiki/65832901/articlequality
- "prediction": "6": https://ores.wikimedia.org/v3/scores/ptwiki/67282651/articlequality