Page MenuHomePhabricator

Community Relations Specialist support for Scoring Platform
Open, NormalPublic


What is the problem?

The Scoring Platform team works with Wikimedia projects to deploy machine learning models on their projects in their language. These initiative often succeed at engaging the communities at all stages, from initial investigation to initial deployment to even quality control. This is not only good practice, it is required: without participation of the communities, we do not have the language assets needed to deploy models.

ORES currently supports ~50 wikis. We are interested in supporting more wikis over time, as well as having conversations with our communities about quality control, especially considering we are currently working on the Jade extension as the audit mechanism for ORES.

How can we help you?

I am interested in having a community relations specialist as a consultant to help us plan our outreach to communities around ORES and Jade. For the next few months this will mostly be occasional consulting around strategy and help us check our assumptions around community practices. Once we backfill our senior engineer role we will probably begin making plans for deployment, which will likely mean a more active role for the specialist. Our target Wikipedias are Arabic, Catalan, Persian, and Finnish (contingent on them approving this, that is).

Also, I think in general a specialist could make sure our community communication practice is up to code, especially since it is so important to what we do.

What does success look like?

  1. In the short term, we will have some strategy for engaging the target wikis. Ideally they will all approve of Jade or at least have actionable feedback for us.
  1. In the longer term, Jade is deployed to some pilot wikis. It doesn't have to be the original four target wikis or even four wikis necessarily.
  1. We have more efficient team procedures around reaching out to communities, working with them to deploy models, and working with them to audit them.

What is your deadline?

We would like an initial meeting sometime in the next two weeks. We are also interested in pursuing more dedicated specialist resources in the next fiscal year.

Event Timeline

Harej created this task.Feb 27 2019, 8:52 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 27 2019, 8:52 AM
Elitre added a subscriber: Elitre.Mar 4 2019, 3:42 PM

Thanks for filing, triaging.

Elitre claimed this task.Mar 4 2019, 3:49 PM

(And to make sure I don't forget about re-assigning this, I temporarily assign it to myself to make sure it doesn't get lost anywhere.)

Johan claimed this task.Mar 4 2019, 4:14 PM
Restricted Application added a project: User-Johan. · View Herald TranscriptMar 4 2019, 4:14 PM
Johan added a comment.EditedMar 4 2019, 5:24 PM

I'll take a look at this. @Harej, I've scheduled a meeting on Monday next week.

Johan moved this task from Backlog to Do soon on the User-Johan board.Mar 4 2019, 5:24 PM
Johan moved this task from Do soon to Do now on the User-Johan board.Mar 21 2019, 1:56 PM

Met with @Harej. We talked about what we could do generally and he should come back with a more specific request.

Elitre triaged this task as Normal priority.Mar 26 2019, 3:20 PM
Johan added a comment.Apr 1 2019, 9:35 PM

@Harej No hurry from our side, take whatever time that makes sense for you, but I just wanted to check in and make sure we hadn't missed any communication from your side?

Harej added a comment.Apr 1 2019, 9:56 PM

You have not missed anything. I will update this task when there is a more precisely scoped project.

I talked to @Harej about what he had in mind for this work. It reminded me of the work I was doing with @Keegan to describe product communication practices around ORES year (or two?) ago. Maybe some of that would would be valuable for getting started here.

Johan moved this task from Do now to Do later on the User-Johan board.May 7 2019, 12:30 PM