As long as the size of the edit set is significantly smaller than the original one (hundreds), we can just ask the people who have reviewed more than, say, 100 edits to not participate this time, to make this training set mostly independent.

@Halfak can I help move this along? If you can specify the conditions and the expected format, I can produce a dataset.

I created a new campaign with 500 items marked damaging or badfaith. See https://labels.wmflabs.org/ui/huwiki/

I named the campaign "Edit quality re-label (500)". I can update that with a translated string if you can give me the text.

Thanks @Halfak! "Edit quality re-label" is "Szerkesztési minőség újraosztályozása".

Since we want to avoid the same people dominating the labeling, we depend on T223899: Information about finished campaigns should be accessible in Wikilabels or some other way of getting a list of top labelers.

OK the name is updated. We have a change that should allow the finished campaigns to be visible. I'll work on a deployment.

New deployment is out. You can see stats on the old campaign here: https://labels.wmflabs.org/stats/huwiki/33

Thanks! Announced and asked for participation here: https://hu.wikipedia.org/wiki/Wikip%C3%A9dia:J%C3%A1r%C5%91r%C3%B6k_%C3%BCzen%C5%91fala#ORES_oszt%C3%A1lyoz%C3%A1sok_fel%C3%BClvizsg%C3%A1lata

@Groceryheist this might be interesting for you.

@Halfak seems like something is wrong with wikilabels, after creating a new workset the request for workset contents (https://labels.wmflabs.org/campaigns/huwiki/<user>/<workset>/?tasks=&campaign=) returns tasks: [] so wikilabels shows a 0/0 progress bar and throws Could not select task. Index 0 out of bounds. at TaskList.selectByIndex on the JS console and Nem sikerült betölteni a(z) „damaging_and_goodfaith” űrlapot: $2 gets disoplayed to the user. Several other users have reproduced this (but not everyone who tried). Should I make a separate bug report?

@Halfak labeling is now mostly done (474 out of 500), all the remaining items need privileged access, and none of the admins are able to use the labeling tool due to the aforementioned bug (which seems to only affect a subset of the users).

OK that's great. We can work with this.

Are there any new information/update?

We should have the updated model deployed early this week. Sorry for the delay! We had a couple minor hiccups last week with this deployment because there's a few other things going out with it.