| Urbanecm_WMF | |
| Sep 27 2022, 10:24 AM |
| F35792231: image.png | |
| Nov 17 2022, 10:02 PM |
| F35792228: image.png | |
| Nov 17 2022, 10:02 PM |
| F35792226: image.png | |
| Nov 17 2022, 10:02 PM |
We should add mentorship-related metrics to the Growth team product KPIs dashboard. Metrics to include:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Trizek-WMF | T247507 Scale: deploy Growth features to 100 wikis | |||
| Open | None | T249987 Scale: GrowthExperiments wiki monitoring dashboard | |||
| Resolved | Urbanecm_WMF | T318684 Add mentorship numbers to the Growth team product KPIs dashboard |
The metrics definition to be-confirmed.
This will likely be implemented as a regularly running maintenance script, at least assuming activity/newcomers registered continue to be in the final list of metrics.
@Urbanecm_WMF does this need discussion/analysis? If so, could you clarify please what you would like to discuss?
Original reason for putting this to Needs Discussion was to group-decide/confirm which mentorship metrics do we want. I suggested some in the task description, but that's just my opinion.
Let's wait for team feedback until Oct 17. If there will be no comments, I'll implment the metrics mentioned above.
Change 849492 had a related patch set uploaded (by Urbanecm; author: Urbanecm):
[mediawiki/extensions/GrowthExperiments@master] [WIP] Calculate mentorship-related metrics
Change 849492 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Calculate mentorship-related metrics
Moving back to In progress, needs the script to be manually ran to ensure it works, and a new systemd timer to execute the script periodically.
Change 853265 had a related patch set uploaded (by Urbanecm; author: Urbanecm):
[operations/puppet@production] growthexperiments.pp: Run updateMetrics.php daily
Change 853440 had a related patch set uploaded (by Urbanecm; author: Urbanecm):
[mediawiki/extensions/GrowthExperiments@wmf/1.40.0-wmf.8] Calculate mentorship-related metrics
Change 853440 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@wmf/1.40.0-wmf.8] Calculate mentorship-related metrics
Mentioned in SAL (#wikimedia-operations) [2022-11-07T06:54:58Z] <urbanecm@deploy1002> Started scap: Backport for [[gerrit:853509|Add support for gemm_mentee_is_active (T318457)]], [[gerrit:853440|Calculate mentorship-related metrics (T318684)]]
Mentioned in SAL (#wikimedia-operations) [2022-11-07T06:55:22Z] <urbanecm@deploy1002> urbanecm and urbanecm: Backport for [[gerrit:853509|Add support for gemm_mentee_is_active (T318457)]], [[gerrit:853440|Calculate mentorship-related metrics (T318684)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet
Mentioned in SAL (#wikimedia-operations) [2022-11-07T07:01:25Z] <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:853509|Add support for gemm_mentee_is_active (T318457)]], [[gerrit:853440|Calculate mentorship-related metrics (T318684)]] (duration: 06m 27s)
The updateMetrics.php script is now available in production (and it works). The next step is to deploy the Puppet patch, which will execute it once a day.
Change 853265 merged by Filippo Giunchedi:
[operations/puppet@production] growthexperiments.pp: Run updateMetrics.php daily
This is now technically done. The only remaining thing is to add the charts to the KPI dashboard.
The systemd timer seems to be working as expected. The metrics job was started today at 04:30, and finished at 04:32 with no errors or warnings.
I've added the new metrics to the KPI board. Unlike all other metrics on the board, the mentorship metrics are per-wiki, as I don't see how to reasonably aggregate number of mentors across wikis.
See screenshots below:
 |  |  |
@Trizek-WMF @KStoller-WMF If you have any feedback about the charts, please share it here!
Thank you, @Urbanecm_WMF , this looks good to me! I've included mention of this in our weekly update: https://www.mediawiki.org/wiki/Growth/Growth_team_updates