Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | SBisson | T161628 Deploy ORES RC Filters in Korean Wikipedia | |||
Resolved | Halfak | T161629 Train/test damaging and goodfaith models for kowiki | |||
Resolved | revi | T161627 Complete editquality campaign for Korean Wikipedia | |||
Resolved | Halfak | T161622 Deploy editquality campaign in Korean Wikipedia |
Event Timeline
Proposed config for goodfaith
level | default config | precision | recall | range | proposed config | precision | recall | range |
---|---|---|---|---|---|---|---|---|
likelygood | maximum recall @ precision >= 0.995 | 0.995 | 0.833 | 0.808 - 1 | maximum recall @ precision >= 0.99 | 0.99 | 0.94 | 0.617 - 1 |
maybebad | maximum filter_rate @ recall >= 0.9 | 0.062 | 0.901 | 0 - 0.909 | maximum recall @ precision >= 0.15 | 0.15 | 0.504 | 0 - 0.606 |
likelybad | maximum recall @ precision >= 0.6 | 0.612 | 0.128 | 0 - 0.216 | use default | - | - | - |
verylikelybad | false (disabled) | - | - | - | use default | - | - | - |
Proposed config for damaging
level | default config | precision | recall | range | proposed config | precision | recall | range |
---|---|---|---|---|---|---|---|---|
likelygood | maximum recall @ precision >= 0.995 | 0.995 | 0.703 | 0 - 0.137 | maximum recall @ precision >= 0.99 | 0.99 | 0.801 | 0 - 0.283 |
maybebad | maximum filter_rate @ recall >= 0.9 | 0.113 | 0.902 | 0.153 - 1 | use default | - | - | - |
likelybad | maximum recall @ precision >= 0.6 | 0.612 | 0.133 | 0.77 - 1 | maximum recall @ precision >= 0.45 | 0.456 | 0.21 | 0.699 - 1 |
verylikelybad | maximum recall @ precision >= 0.9 | 0.942 | 0.022 | 0.959 - 1 | (maybe?) maximum recall @ precision >= 0.75 | 0.758 | 0.092 | 0.851 - 1 |
Looks good to me.
Re damaging maybebad: I was wondering why you didn't pick 15% precision there, but now I see that that drops the recall all the way down to 75%, which I agree isn't worth it.
Re damaging verylikelybad: yeah 9.2% recall isn't great, but I'm leaning towards including it rather than dropping the verylikelybad level.
Change 494222 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[operations/mediawiki-config@master] Enable and configure ORES goodfaith and damaging rcfilters
Change 494222 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable and configure ORES goodfaith and damaging rcfilters
Change 494301 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[operations/mediawiki-config@master] Enable and configure ORES goodfaith and damaging rcfilters
We tried to deploy this today at 19:00 UTC but failed. We'll try again in the 00:00-01:00 UTC deployment window. (cc @revi )
Change 494301 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable and configure ORES goodfaith and damaging rcfilters on kowiki
Mentioned in SAL (#wikimedia-operations) [2019-03-05T00:12:42Z] <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable ORES on kowiki (T161628) (duration: 00m 49s)