Page MenuHomePhabricator

Deploy Growth experiments at Russian Wikipedia
Open, Needs TriagePublic

Description

Note: in this deployment, we should run a welcome survey experiment. This can either be matching the 80/20 split of the rest of the Growth experiment, or it can be an independent 50/50 spit to maximize its speed to significance, whichever is easier.

First

  • Get an agreement from the community to deploy these features: discussion.
  • List people we can contact for the next steps:

Translations

Help panel

  • Help desk: Q11059110 Q5621643 or Q16503
  • Archiving system: Archived after 30 days of inactivity and after 7 days of inactivity for resolved questions
  • Help pages (you can provide either a Wikidata link or a link to your wiki):
    • Manual of style: Q4994848
    • Help:Editing: Q151637
    • Inserting images using the visual editor: no page found on Q27919584
    • Inserting references using the visual editor: no page found on Q24238629
    • Article Wizard: Q10968373
  • Search on namespace: 4 "Wikipedia" and 12 "Help" (default)
  • Read more : Q914807

Homepage

Suggested edits

Suggested edits are based on these 5 task-types. At the moment, they can't be substituted. Pleas check maintenance template and links:

TaskDifficulty levelMaintenance templatesLearn more
Copyedit articleEasyQ6292692no page found on Q10953805
Add LinksEasyQ5849007Q6521720
Update articleMediumQ5617874Q11128024
Add ReferencesMediumQ5962027 (or Q6192879)Q642335
Expand articleHardQ5866533Q14360362

For templates only, you can suggest more templates that match the task description.

Extra links:

Welcome survey

  • Get an agreement from the community to deploy these features: we have agreed to deploy the welcome survey in an A/B test to check its impact on newcomers.
  • Translate the interface

Understanding first day

Get an agreement from the community to deploy these feature

Anything else?

We use the bot for the template {{hello}}, with automatic substitution of names from this list, and we have FlaggedRevs extension.

Event Timeline

Iniquity created this task.Jul 8 2020, 5:50 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 8 2020, 5:50 PM
Iniquity changed the task status from Open to Stalled.Jul 8 2020, 5:56 PM
Iniquity updated the task description. (Show Details)Jul 8 2020, 6:19 PM

Thank you for creating this task, @Iniquity. :)

For your information, I'm on vacation until July 22. If you have any question about the tools, please ask @MMiller_WMF!

Thank you for creating this task, @Iniquity. :)

For your information, I'm on vacation until July 22. If you have any question about the tools, please ask @MMiller_WMF!

Well, thanks for saying :) Good rest.

Iniquity updated the task description. (Show Details)Thu, Jul 16, 8:32 PM
Kf8 added a subscriber: Kf8.Thu, Jul 16, 11:47 PM
Iniquity updated the task description. (Show Details)Fri, Jul 17, 1:12 AM
Iniquity updated the task description. (Show Details)Fri, Jul 17, 1:21 AM
Iniquity updated the task description. (Show Details)Fri, Jul 17, 1:41 AM
Base added a subscriber: Base.Fri, Jul 17, 1:43 AM
Meirae added a subscriber: Meirae.Fri, Jul 17, 2:26 AM
Iniquity updated the task description. (Show Details)Sun, Jul 19, 6:29 AM

I'm back. :)

How things are going, @Iniquity?

@Trizek-WMF, Its good :)

I'm waiting for the community discussion to complete. It seems that all the texts have been translated. Mentors are really few for the home page :(

Mentors are really few for the home page :(

Ideally, you would need 26 mentors (~13k new users per month / 500). Less is fine though: when the first mentors will get some questions, they may promote the participation.

Ailbeve updated the task description. (Show Details)Fri, Jul 31, 11:02 PM
Iniquity changed the task status from Stalled to Open.Tue, Aug 4, 1:54 PM
Iniquity updated the task description. (Show Details)

Thank you for the update! ;)

Iniquity added a comment.EditedTue, Aug 4, 2:12 PM

Thank you for the update! ;)

You are welcome :) We have a very shaky consensus on the Welcome survey. Is it possible to enable it only for a month and check how it affects on new users?

We already have checked on multiple wikis if it affects new users and it doesn't.

What are the concerns and reasoning around this? This is something we may help with. Let me know!

Mainly arguments: "I would not work with Wikipedia myself if you showed me this poll. Users will think that we want to steal their data"

Iniquity updated the task description. (Show Details)Tue, Aug 4, 2:31 PM
Iniquity updated the task description. (Show Details)

Mainly arguments: "I would not work with Wikipedia myself if you showed me this poll. Users will think that we want to steal their data"

It is a legit concern. However, I don't see which kind of personal data would be collected there, except favorite topics and reasons why people create an account.

In the survey itself, we highlight the fact that we do not collect any personal data. Maybe one sentence in particular raises concerns?

The Wikimedia Foundation will use your answers to help you start editing [wiki]
Almost every page can be edited by anyone, and hundreds of changes are made every hour to add content, correct mistakes, and improve readability. The following pages can help if you’re interested in contributing.

New users can also skip this survey.

Which proportion of users raised this up?

Which proportion of users raised this up?

Enough to cause concern :) You can google translate this part of consensus. I just need data about our test to convince them.

Like the other tools, the welcome survey is deployed to 80% of newcomers. We keep a tracking group of 20% to see if the survey impacts account creations. It is done for every wikis, except small ones (and you're not a small one).

It is equivalent of the one-month trial you suggest. It is even better, because longer: one bad month can happen (less registrations in August because of summer vacations, for instance), but three bad months in a row are less likely to happen.

Would this reassure your community?

Thank you for your help! ;)

I think yes, but in any case I will need the same report :)

Iniquity updated the task description. (Show Details)Wed, Aug 5, 5:06 PM

@Iniquity -- yes, we can specially run the experiment around the welcome survey to check whether it depresses the number of newcomers who make edits, and we will be able to report back after about 6 weeks.

MMiller_WMF updated the task description. (Show Details)Wed, Aug 5, 5:30 PM
MMiller_WMF updated the task description. (Show Details)
MMiller_WMF added a subscriber: Catrope.

@Iniquity -- yes, we can specially run the experiment around the welcome survey to check whether it depresses the number of newcomers who make edits, and we will be able to report back after about 6 weeks.

It would be cool :)

Iniquity updated the task description. (Show Details)Wed, Aug 5, 5:46 PM
Iniquity updated the task description. (Show Details)Wed, Aug 5, 11:57 PM

Hi :) When it is appear? :)

Trizek-WMF updated the task description. (Show Details)Mon, Aug 10, 3:00 PM
Trizek-WMF updated the task description. (Show Details)

Hi :) When it is appear? :)

Hi! The team will discuss about it today.

In the meantime, please check on the task description. I found that 3 links are missing.

On the welcome survey, we have recently added a new question about languages people understand, so that we can know if suggesting translations as a task would be a good idea. This needs some extra work on translations (2 more messages).

In the meantime, please check on the task description. I found that 3 links are missing.

Oh, I see :) Thanks, we try to fix it soon as possible.

@Trizek-WMF I suddenly thought, why is it required to specify a template, and not a category for 'Suggested edits'? We have just half of the articles using a universal template {{rq}} with additional parameters.

We use templates because they are relied to one category only (mostly). This is not the case with categories, that can be attached to multiple templates (like the "multiple issues" template). These templates are confusing to users, since they can't find a clear direction when they open the article.

Polish Wikipedia had the same issue as you have with templates and we have a fix. It requires some work on your side.

We suggest that you create "dummy" templates for each task types we need and then and then add {{#ifexist:maintenance-{{{1}}}|{{maintenance-{{{1}}}}}}} to the main template to have it working. It is very unlikely that people would use the dummies, since finding templates relies on search, and search suggests the most used templates.

Let me know if you have questions!

That is, it will search the entire template tree, hmm... It's okay that our template may have several issues in one? I mean, it looks a lot like "multiple issues" from enwiki.

We try not to use the "multiple issue template. :)

Have one template that lists numerous things confuses people: "what's important?" "If I have to do X but I read that X, Y and Z must be completed, what should I do?"

We try to select articles that have one template, which clearly tells the user what to do. It is easy to fix one thing instead of multiple things at once. Fixing multiple things at one is for experienced users.

Iniquity added a comment.EditedMon, Aug 10, 7:52 PM

We try not to use the "multiple issue template. :)

Have one template that lists numerous things confuses people: "what's important?" "If I have to do X but I read that X, Y and Z must be completed, what should I do?"

We try to select articles that have one template, which clearly tells the user what to do. It is easy to fix one thing instead of multiple things at once. Fixing multiple things at one is for experienced users.

Then we have a problem :) The simple copyedit template has only 50 inclusions. We can change it to 'wikify' template.