Change 489984 had a related patch set uploaded (by Catrope; owner: Catrope):
[operations/mediawiki-config@master] Enable ORES on dewiki

https://gerrit.wikimedia.org/r/489984

Forgot to say this earlier: I've scheduled the above patch for deployment on Thursday February 14 at 00:00-01:00 UTC (Wednesday 16:00-17:00).

In T215354#4950181, @Catrope wrote:

Forgot to say this earlier: I've scheduled the above patch for deployment on Thursday February 14 at 00:00-01:00 UTC (Wednesday 16:00-17:00).

Please don't do it for German Wikipedia. The wiki banned using ORES a while back (three or four years ago, a little bit after the Mediaviewer stuff). Deploying it without community approval first probably will cause a mayhem.

Thanks for flagging this, @Ladsgroup. I believe that there was a protocol at some point that involved a community announcement. In the past, I believe this involved work from @Trizek-WMF to announce and discuss the UI change.

See also T164331: Define a process for adding ORES filters to new wikis when ORES is enabled on those wikis

Change 489984 abandoned by Catrope:
Enable ORES on dewiki

https://gerrit.wikimedia.org/r/489984

In T215354#4950607, @Ladsgroup wrote:

In T215354#4950181, @Catrope wrote:

Forgot to say this earlier: I've scheduled the above patch for deployment on Thursday February 14 at 00:00-01:00 UTC (Wednesday 16:00-17:00).

Please don't do it for German Wikipedia. The wiki banned using ORES a while back (three or four years ago, a little bit after the Mediaviewer stuff). Deploying it without community approval first probably will cause a mayhem.

Thanks for flagging that. I have canceled the scheduled deployment.

The Growth team has written this code, and all that is left is community outreach. So @Ladsgroup can take the final steps to execute when ready.

@JTannerWMF, per T164331: Define a process for adding ORES filters to new wikis when ORES is enabled on those wikis, I believe we'd decided that it is the #Growth team's responsibility to get buy-in for enabling these features since you're maintaining the UI. I'd suggest reaching out to the Wikipedians who did the most labeling work.

When we have bandwidth we will discuss this task with @Trizek-WMF

The request to have ORES filters on de.wp has been made by some community members. IIRC what we discussed, they should take care of announcing it.

If I'm wrong, please fill a request.

@Halfak @Ladsgroup -- @Trizek-WMF and I talked about this. Looking at @Ladsgroup's comment above about how dewiki banned ORES, it seems like the wiki would have to have a new conversation about enabling these models, facilitated by someone from WMF Community Relations. Does that sound like the appropriate next to happen? If so, we will in fact need to file a Community Relations request because Growth team wasn't expecting to add this to our to-do list in the near-term; we're currently doing a ton of community relations as we expand the help panel and newcomer homepage to more wikis. Does building the ORES models come with any validation or other materials to help the community understand how they will perform?

You can get fitness statistics directly from the service. Here's some relevant statistics for the English Wikipedia models and the German Wikipedia models.

https://ores.wikimedia.org/v3/scores/dewiki/?models=damaging|goodfaith&model_info=statistics.roc_auc|statistics.pr_auc|statistics.precision|statistics.recall

https://ores.wikimedia.org/v3/scores/enwiki/?models=damaging|goodfaith&model_info=statistics.roc_auc|statistics.pr_auc|statistics.precision|statistics.recall

In comparison, the German Wikipedia model fares better than the English Wikipedia model. While this comparison is hard to make directly. Surely there are different *types* of vandalism that happen in dewiki vs enwiki. But this gives a general sense that, by the numbers, it looks like the models will work well.

Also, please convey that we prioritize fixing the issues they identify in the wild. So if German Wikipedians can tell us that ORES is generally getting some type of edit wrong, we'll prioritize the work to look into that problem highly.

@Ladsgroup -- I wanted to follow up on my question above. Since dewiki previously banned ORES, do you think that the wiki would need to have a new conversation and consensus about the models before they are deployed?

For clarity, I don't think ORES was ever "banned", but we did receive resistance when we first sought to document ORES on dewiki. That was back in 2014. I think *some* discussion is necessary before we do any deployment on German Wikipedia.

It looks like an old discussion was posted that suggested ORES was coming in some future iteration on RCFilters. See https://de.wikipedia.org/wiki/Wikipedia:Projektdiskussion/Some_updates_about_Recent_Changes_page

It doesn't look like there was any substantial push-back at that point.

I am moving this to blocked, we can't proceed on this task until there is discussion with German Wikipedia. Tagging @Halfak for awareness.