This milestone tests the hypothesis. We measure the new process on-wiki against the baseline from T440035, over the two weeks after Milestone 2 is deployed. We encourage pilot communities to use the new process from the day of deployment, so two weeks gives enough data. It is done when we can say, with numbers, whether a simpler process led to more language-specific Functions from pilot communities.
The work is:
- Count the new process for the reference example. We repeat the Milestone 0 count with the new flow, and compare it with the target: one page, with no ZIDs and no argument types, counts or order typed by hand.
- Report where users stop. From the stage data, we report how many new Functions reach each stage. The stage where most users stop tells us what to simplify next.
- Measure the coverage of the focus languages again. We compare coverage for Igbo, Malayalam, Dagbani and English with the Milestone 0 baseline. This is the measure that links this work to the pilot integration of abstract articles into Wikipedias.
- Collect and sort feedback from pilot communities on-wiki. We ask for feedback on Wikifunctions, and file each problem as a follow-up task. Feedback on-wiki is public and stays with the record, unlike notes from individual sessions.
- State whether the hypothesis was supported. We write a short result on this task, with the numbers, and a recommendation for the next steps.
Acceptance criteria
- The new step count is published on this task, and it meets the target or the gap is explained.
- The stage report is published, and names the stage where most users stop.
- The coverage of the focus languages is published with the baseline next to it.
- Each problem from the feedback has a follow-up task.
- This task states whether the hypothesis was supported.
Not in this milestone
New features in response to feedback, which are follow-up tasks; and any judgement of the quality of the output for a language.