|Resolved||Catrope||T197012 Enable srwiki edit quality filters in RecentChanges|
|Open||None||T223273 Update srwiki thresholds for goodfaith model|
|Open||Halfak||T199355 Investigate srwiki goodfaith model, why is it so bad?|
|Resolved||None||T220556 New labeling campaign for srwiki|
Sorry this one as left hanging for a while. We'll be giving this priority and doing some exploration ASAP.
First thing I want to try is to re-review the "bad-faith" labeled edit from the campaign to see if there is something weird going on. I'll ping soon with some information about that.
I've dumped all of the edits labeled "badfaith" into this etherpad: https://etherpad.wikimedia.org/p/srwiki_badfaith_edits
There are ~450 of them -- which is quite a lot. We don't need to re-label them all, but maybe we can check what is there. @Acamicamacaraca, I can do a bit of work using translation utilities, but I'd appreciate it if you could look at 25-50 of these and just write a short description of what you're seeing and if you agree with the label. I'd really be interested in any help from other srwiki-pedians too :)
It looks like a lot of the edits that were labeled "badfaith" but that we have no re-labeled "goodfaith" were saved by @Zoranzoki21. That might be simply because Zoranzoki21 did a lot of labeling work. Would you take a look at them to see if you agree with our re-assessment? Maybe there is some confusion as to the meaning of "goodfaith".
OK it's clear that we would benefit from re-labeling these 500 revisions using Wiki labels. I'm working to get a campaign loaded. I'd like to call it something like "Edit quality (500 edits re-review)" or something like that. Could someone help me get a Serbian translation of that?
Just sat down with this again. Here's the old dataset:
And the new re-labeled dataset:
Just at a glance this looks way more reasonable. In the original edits, we had 10 edits labeled as not damaging, but still "badfaith". Now those have disappeared and we've gone from 447 badfaith edits to 151.
I'm re-training the models now. I'll report back tomorrow on the fitness we get.