Page MenuHomePhabricator

Quarterly report of reference quality by language project
Closed, DeclinedPublic

Description

  • Context. Provide a short paragraph with some background context for your request, please include links to relevant material.

Miriam's recent presentation had information about reference quality on enWiki, and how the presence of the perennial sources list there created higher quality referencing throughout articles on the language project.

I'm wondering if that data can be chopped up quarterly since the start of 2018 and for as many language projects it can be calculated. I understand that only 6 PSL are well maintained. So i'll take for whatever is possible!

  • Description.What is your request about?

My request is key for my product development as well as for marketing for WME.

  • Expected Deliverable. What is the ideal outcome or result of your request?

Ideally a similar chart to the one Miriam created for her presentation (slide 22). If this is too heavy or annoying I can certainly make a visualization out of a CSV myself.

  • Estimated Effort. Please provide an estimate of the amount of work needed to complete this task, if known.

Unknown. I understand that a an ML model is used to make such data.

  • Priority

Medium/Low - this can certainly wait a quarter, but of course if easy, rather have it sooner!

I need this task resolved in:

  • 3 months.
  • Other. Do you have any other questions or comments ?

No! just thank you and to please reach out to me should there be questions!


For use by WMF Research team; please leave everything below as it is:

  1. Does the request serve one of the existing Research team's audiences? If yes, choose the primary audience. (1 of 4)
  2. What is the type of work requested?
  3. What is the impact of responding to this request?
    • Support a technology or policy need of one or more WM projects
    • Advance the understanding of the WM projects.
    • Something else. If you choose this option, please explain briefly the impact below.

Event Timeline

@diego we will need your input as we discuss the prioritization of this request. FYI @KHernandez-WMF will add you to our next Research backlog grooming meeting.

@FNavas-foundation thank you for submitting this request. We reviewed it in our prioritization meeting. More updates below.

Decision: Decline.
Reason: The primary reason for declining this request is that @diego assesses the output of the model to be a good step for a research publication. However, the model needs to be improved for the output to be at the level that we would like to support Wikimedia Enterprise with. My understanding is that Diego has had early conversations with folks in WM Enterprise and there may be budget for a contractor to specifically work on this front in Q3+.
Next steps: If you decide to hire a contractor to work on improving the model in Q3, please coordinate with us in early December. We're locking Q3 goals by December 20th (earlier than usual given that many will be in holidays in late December). Diego will need to set aside time in Q3 on his end to work with the contractor and we need to determine the prioritization of this work before we lock our Q3 commitments. The step after the model has the output that Diego assesses as ready to go would be for our research engineers to receive more specifications from you in order to be able to properly set the reporting. I suggest that we stage this work: first figure out if we can prioritize resources for the model to be improved and then look into engineering support needed.

I really appreciate your desire to work with Research to support the work of WM Enterprise. I hope I have provided sufficient information in this comment to help you proceed from here.