Page MenuHomePhabricator

Mentorship: ensure that all mentees are assigned to an active mentor
Open, MediumPublic

Description

The Growth Team is performing some "clean up" work to ensure all accounts with "Display newcomer homepage" preference enabled and Mentorship features enabled are assigned to active mentors.

This should ensure that newcomers aren't asking questions to an account that is no longer active or a user who is not interested in continuing to be a mentor.


What happens?:
User:Sskytw said their mentor is User:Emojiwiki on zhwiki. I have confirmed it by using magic word {{#mentor:Sskytw}}.
User:Emojiwiki quitted the mentorship on 2022-03-19 without using Special:QuitMentorship.
I found there are lots of mentees are still assigned to User:Emojiwiki. https://zh.wikipedia.org/w/api.php?action=query&format=jsonfm&list=growthmentormentee&formatversion=2&gemmmentor=Emojiwiki
And I can't use the Special:ManageMentors/remove-mentor to reassign those mentees. It shows "Mentor Emojiwiki is not in the mentor list".
So help us to solve it.

Software version (skip for WMF-hosted wikis like Wikipedia):
GrowthExperiments a9cfd6b


NOTE: this script was stopped after it caused some community confusion and frustration.

We will postpone resuming the script until we can complete these tasks:

  • Remove blocked users from Mentorship (T351234)
  • Update the copy (T351241).
  • Generate only one log entry when a mentor is removed from the list (T345016)
  • Merge claimmentee and setmentor filters in GrowthExperiments log (T349434)
  • Ensure quitting causes mentee reassignment for all mentors irrespective of how many mentees they have assigned (T354222)

Related Objects

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Tgr added subscribers: Urbanecm_WMF, Tgr.

Probably just add them back to the mentor list, and then use ManageMentors?
(cc @Urbanecm_WMF)

That would be the easiest solution, yes. @Xiplus, can you try:

  1. Adding them to MediaWiki:GrowthMentors.json page (F36863677 is a diff that should work for this purpose)
  2. Going to Special:ManageMentors, and hitting the "Remove mentor" link

This should trigger the automatic reassignment feature. Hope it helps!

Thanks! It works. These mentees have been reassigned to other mentors:
https://zh.wikipedia.org/w/index.php?title=Special:日志/growthexperiments&type=growthexperiments&user=&offset=20230222030628|12712095
I also reassigned mentees for 3 other past mentors.

Urbanecm_WMF moved this task from New Tasks to Prioritized on the GrowthExperiments-Mentorship board.

We agreed in the 2023-05-10 Mentorship meeting to reassign all mentees currently assigned to non-mentors on all projects. This should resolve similar situations for all other projects as well.

KStoller-WMF renamed this task from Some mentees are still assigned to a past mentor on zhwiki to Mentorship: ensure that all mentees are assigned to an active mentor.May 15 2023, 9:48 PM
KStoller-WMF updated the task description. (Show Details)

Change 937950 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@master] Add reassignMentees.php maintenance script

https://gerrit.wikimedia.org/r/937950

Please move back to In Progress after merging, as this will need to be executed in production to complete the work.

Sgs changed the task status from Open to In Progress.Jul 21 2023, 9:22 AM
Sgs moved this task from Code Review to In Progress on the Growth-Team (Sprint 0 (Growth Team)) board.

Change 937950 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] Add reassignMentees.php maintenance script

https://gerrit.wikimedia.org/r/937950

Change 940142 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@wmf/1.41.0-wmf.18] Add reassignMentees.php maintenance script

https://gerrit.wikimedia.org/r/940142

Change 940142 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.41.0-wmf.18] Add reassignMentees.php maintenance script

https://gerrit.wikimedia.org/r/940142

Mentioned in SAL (#wikimedia-operations) [2023-07-24T07:17:55Z] <urbanecm@deploy1002> Started scap: Backport for [[gerrit:940142|Add reassignMentees.php maintenance script (T330071)]]

Mentioned in SAL (#wikimedia-operations) [2023-07-24T07:32:34Z] <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:940142|Add reassignMentees.php maintenance script (T330071)]] (duration: 14m 39s)

KStoller-WMF moved this task from Incoming to QA on the Growth-Team (Sprint 1 (Growth Team)) board.
KStoller-WMF subscribed.

Moving to QA, but feel free to move back to In Progress if that's incorrect.

Urbanecm_WMF added a subscriber: Trizek-WMF.

Moving to QA, but feel free to move back to In Progress if that's incorrect.

As I mentioned in sprint review I think, we still need to run the reassignment script I've created for this task to be completed. I need to sync with @Trizek-WMF on this. I have it as a reminder for when he comes back. Moving to Blocked for now.

IIRC, the mass confusion was on the notifications newcomers received, reaching out to their new mentor who wasn't aware of the change. I think we should work on T327493: Message received by the newcomer when their mentor quits could be improved before doing a new re-assignement.

Fixing the message will help, even if we will always have a few newcomers reaching out to their new mentor. Consequently, I think we should announce the reassignment in Tech News.

Thanks @Trizek-WMF! Let's move this to Backlog temporarily, work on T327493 first and complete this task in the next sprint.

Thanks @Trizek-WMF! Let's move this to Backlog temporarily, work on T327493 first and complete this task in the next sprint.

With the other task having the change merged, moving into sprint.

Blocked on T327493 getting deployed and this task getting announced. Let's do this late next week (Thursday, Nov 09), if that's fine with everyone.

Re: Tech News - What wording would you suggest as the content?
Please either let me know here, or add it directly to the upcoming edition (within ~24 hours, after which it will be frozen for translations). Thanks.

I suggested the following language:

The Growth team has been hard at work enhancing Mentorship for a better user experience. On November 9th, we’re reassigning some newcomers from inactive mentors to active ones (T330071). Plus, we’ve revamped our notification language to be more user-friendly (T327493).

But @Quiddity is more than welcome to revise that to be more appropriate for Tech News.

Thanks @KStoller-WMF! I saw @Quiddity (thanks) added a revised version to the tech news already. I slightly revised it as well (diff): most importantly, I changed "inactive mentors" with "former mentors", as we do not judge activity (answering questions or just editing Wikipedia) in any way, we merely take away newcomers from users who used to serve as mentors, but don't anymore (whether by their own choice, or because they were removed by their community). Hopefully those changes make this ticket a bit easier to understand. Feel free to revert or revise further as needed!

Thanks @KStoller-WMF! I saw @Quiddity (thanks) added a revised version to the tech news already. I slightly revised it as well (diff): most importantly, I changed "inactive mentors" with "former mentors", as we do not judge activity (answering questions or just editing Wikipedia) in any way, we merely take away newcomers from users who used to serve as mentors, but don't anymore (whether by their own choice, or because they were removed by their community). Hopefully those changes make this ticket a bit easier to understand. Feel free to revert or revise further as needed!

👍 Ah, good catch. Thank you!

Wonderful! In that case, let's aim for this Friday or Monday Nov 13. We've already mentioned this in "future changes" section of one of the recent tech news, so that should be okay doing.

Urbanecm_WMF changed the subtype of this task from "Bug Report" to "Deadline".Nov 8 2023, 5:38 PM
Urbanecm_WMF set Due Date to Nov 13 2023, 10:00 PM.

Mentioned in SAL (#wikimedia-operations) [2023-11-13T20:47:18Z] <urbanecm> mwmaint2002: mwscript extensions/GrowthExperiments/maintenance/reassignMentees.php --wiki=arwiki --all --performer='Martin Urbanec (WMF)' (T330071)

Script's still running, leaving it to run overnight.

The script was stopped as apparently indefinite blocked users are getting a mentor.

Also, the log message should be changed to $oldmentor retired from mentorship., which is more neutral.

The script was stopped as apparently indefinite blocked users are getting a mentor.

Split that question to T351234: Mentorship: Remove blocked users from Mentorship.

Also, the log message should be changed to $oldmentor retired from mentorship., which is more neutral.

I'm not sure I understand this. This appears to be the currently used message? Can you please fill a task describing what should get changed? Thanks!

Urbanecm_WMF raised the priority of this task from Low to Medium.Nov 14 2023, 3:59 PM

Also, the log message should be changed to $oldmentor retired from mentorship., which is more neutral.

I'm not sure I understand this. This appears to be the currently used message? Can you please fill a task describing what should get changed? Thanks!

T351241: Assignment script log comment should be improved

KStoller-WMF moved this task from Backlog to Blocked on the Growth-Team board.

Moving out of the sprint and into Blocked.

We will postpone resuming the script until we can complete these tasks:

  • Remove blocked users from Mentorship (T351234)
  • Update the copy (T351241).
  • Generate only one log entry when a mentor is removed from the list (T345016)
  • Merge claimmentee and setmentor filters in GrowthExperiments log (T349434)

@Urbanecm_WMF: Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!

Thanks for the ping @Aklapper. I removed the due date, as this turned out to be more work than anticipated, and we would need to first proceed with the tasks @KStoller_WMF listed at T330071#9342055 to be able to finish this one.

@Urbanecm_WMF - a related discussion here: https://en.wikipedia.org/wiki/Wikipedia_talk:Growth_Team_features#Quit_mentorship_but_still_receiving_questions

Does that issue sound related to this task, or is it a different bug? I would have thought that rejoining Mentorship and quitting again would have solved the issue.

Thanks for the ping and for noticing the discussion!

Does that issue sound related to this task, or is it a different bug? I would have thought that rejoining Mentorship and quitting again would have solved the issue.

In a way, this task is a "clean things up" kind of a task. Some time back, we changed the Growth mentorship features to automatically reassign mentees assigned to a mentor who decided to quit. However, our changes do not impact any of the mentors who retired before we made them (this task exists as a clean-up for those legacy former mentors).

Even quitting mentorship for the first time should have resulted in FormalDude's mentees being reassigned to someone else. That didn't work (and it also didn't work when FormalDude tried to quit again, or when Extraordinary Writ or me removed FormalDude as a mentor manually), which is a clear bug in the reassignment system. I prefer tracking such bugs separately. To track the issue reported in the link above, I filled:

  • T354220 to track the particular reported issue (FormalDude having mentees when they shouldn't have), and
  • T354222 to fix the problem in a sustainable way (in other words, making quitting work for mentors who have many mentees assigned).

I decided to fill two tasks rather than one, because I can easily trigger the reassignment process server-side for FormalDude only, see T354220#9431086. I'm not yet sure how to fix the problem long-term; I'll comment at T354222 soon.

I also marked T354222 as a subtask of this ticket, since it does not make sense to proceed with the mass-reassignment until we ensure all mentors (including those with many mentees) can properly quit.