Page MenuHomePhabricator

Run survey for vector 2022 on enwiki
Closed, ResolvedPublic

Description

Background

We would like to survey current Wikipedia readers on their thoughts on the new Vector (2022) skin.

Screen Shot 2022-08-18 at 8.57.07 AM.png (1×2 px, 705 KB)

Acceptance criteria

  • 2. Banners should appear under the following conditions:
  • User is logged-out
  • User is on enwiki
  • User is visiting a page shown in the Vector 2022 skin OR user is visiting a page from the list above (either approach would be acceptable with a preference for the first if possible)
  • 3. Display banner on pages:
  • Banner copy:

Welcome to a sneak preview of the new design for Wikipedia!
We would love your feedback on our changes

Survey link

https://wikimedia.qualtrics.com/jfe/form/SV_dbdunfQbqy1fToy (note: survey is now live)

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

@alexhollender_WMF - next step is to get a before/after image for the survey.

From an engineering perspective (cc @Jdlrobson) we need analysis on:

  • The approach to set these specific pages to display in the new skin (Acceptance criteria 1 above)
  • Targeting central notice to: logged-out users, English Wikipedia, these specific pages (Acceptance criteria 2 above)
ovasileva updated the task description. (Show Details)
ovasileva updated the task description. (Show Details)
ovasileva reassigned this task from Jdrewniak to cjming.
ovasileva added a subscriber: Jdrewniak.

Change 820564 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/skins/Vector@master] Allow preview on certain article titles

https://gerrit.wikimedia.org/r/820564

@alexhollender_WMF are there mocks for the banners we want to display? If not, I'll go ahead with just a skeleton for now.

@alexhollender_WMF are there mocks for the banners we want to display? If not, I'll go ahead with just a skeleton for now.

here is the mockup:

Screen Shot 2022-07-13 at 9.07.30 AM.png (346×1 px, 118 KB)

Change 820564 merged by jenkins-bot:

[mediawiki/skins/Vector@master] Allow preview on certain article titles

https://gerrit.wikimedia.org/r/820564

@alexhollender_WMF, @Jdlrobson - just noting that there is another link for the privacy policy (see AC 3)

@alexhollender_WMF, @Jdlrobson - just noting that there is another link for the privacy policy (see AC 3)

is there any way we can include the privacy policy link within the survey, rather than the banner?

Jdlrobson added a subscriber: Edtadros.

Szymon will setup the banner(s). This will be two using the following skeleton:

<div id="vector-di-preview-banner" style="display:none">This is a banner that only shows up on preview pages.</div>
<script>
var isValidSkin = mw.config.get('skin') === 'vector' || mw.config.get('skin') === 'vector-2022'
vars isVectorPreviewPage = mw.config.get(‘wgVector2022PreviewPages’).indexOf(mw.config.get(‘wgPageName’) === -1;
if ( isVectorPreviewPage && isValidSkin) {
  document.getElementById('vector-di-preview-banner').style.display = 'block';
}
</script>

@alexhollender_WMF, @Jdlrobson - just noting that there is another link for the privacy policy (see AC 3)

is there any way we can include the privacy policy link within the survey, rather than the banner?

@alexhollender_WMF - unfortunately, the legal department requires us to link to the privacy policy within our site, prior to opening the survey

@ovasileva @alexhollender banner is setup at :
https://meta.wikimedia.org/wiki/Special:CentralNoticeBanners/edit/di_sneak_preview

Preview link:
https://meta.wikimedia.org/w/index.php?title=Wikipedia&banner=di_sneak_preview&force=1&preview=1

I am blocked because I need:

A few notes:

  • @alexhollender_WMF I've used the same button styling as the rest of Vector for consistency. T314286#8140798 shows a white button with blue text but that doesn't match any of our available standardized designs and I need to the button to be accessible e.g. hover states etc

@Jdlrobson - the preview isn't working for me for some reason. Is the banner still available for testing?

The privacy url needs to appear within the banner. @alexhollender_WMF to provide the exact location.

  • @ovasileva there supposed to be a second variant of the banner that directs people to a test page or are we intending this as an easter egg?

For now, we're intending to only target people that are visiting those pages specifically, No second banner is necessary.

@Jdlrobson - the preview isn't working for me for some reason. Is the banner still available for testing?

Looks like you need special permissions :( Here's a screenshot so far.

Screen Shot 2022-08-16 at 9.03.40 AM.png (710×2 px, 248 KB)

@alexhollender_WMF to provide the exact location.

Okay. Right now I'm just putting it next to learn more which is no great.

For now, we're intending to only target people that are visiting those pages specifically, No second banner is necessary.

Okay cool. Thanks for clarifying.

Another question:

  • Is it intentional that we don't want the banner to be dismissable?
  • Are we allowed to run banners at 100% coverage? It seems to realize this banner, we'd need to ship the banner code to all pages even though we only show it on a few of the pages. If we can't do that, we'll need to add the banner to the skin which will push the deploy to next week earliest.

Change 823587 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[operations/mediawiki-config@master] Enable new Vector skin on select pages

https://gerrit.wikimedia.org/r/823587

@Jdlrobson - the preview isn't working for me for some reason. Is the banner still available for testing?

Looks like you need special permissions :( Here's a screenshot so far.

Screen Shot 2022-08-16 at 9.03.40 AM.png (710×2 px, 248 KB)

That looks good! We're still missing one link to the Foundation Website Page (copy and link are above in the task description). Also the copy is a little bit off.

Another question:

  • Is it intentional that we don't want the banner to be dismissable?

No reason to have it not be dismissible - we can allow for it to be dismissed.

Looking for a design review, @alexhollender_WMF

Screen Shot 2022-08-16 at 11.28.00 AM.png (840×2 px, 335 KB)

Apparently you can't preview this without special permissions so please let me know if you need 10 minutes to sync on this.

hey @Jdlrobson, apologies for holding you back on this stuff. the screenshot you posted in your last comment didn't work (permission error).

@alexhollender_WMF

  • can you update the mock to includew the close icon?
  • Can you let me know what the margins are between icon and text and text and buttons (if it matters)
  • What font and font-size do we want the copy text and links to be?

I'll check with Olga about copy before finalizing.

@Jdlrobson could this work?

  • margins don't need to be exact, you can just eyeball it
  • font-sizes are included in the mock. font-family: sans-serif;

image.png (1×2 px, 958 KB)

@Jdlrobson what's the best way to design review? I don't have permissions to view this link: https://meta.wikimedia.org/wiki/Special:CentralNoticeBanners/edit/di_sneak_preview

Screen Shot 2022-08-17 at 1.09.16 PM.png (484×902 px, 200 KB)

happy to give a thumbs up based on the screenshot you shared, or is there something else to look at?
{F35469157 width=800}

@alexhollender_WMF if screenshot is not sufficient, I guess we'd need to do a short video call.

Just looking at this again I wonder if the wording could be better. "Welcome to the new design for Wikipedia!" seems to imply this is live already, and users might be confused when they go to other pages and get Legacy Vector (especially as logged out users have no way to get back to Vector 2022 on other pages)

How about "Welcome to a preview of the new design for Wikipedia!" or "Welcome to a sneak preview of the new design for Wikipedia!" I think people might also feel more special if they are getting a "sneak preview", and be more willing to give feedback.

Just looking at this again I wonder if the wording could be better. "Welcome to the new design for Wikipedia!" seems to imply this is live already, and users might be confused when they go to other pages and get Legacy Vector (especially as logged out users have no way to get back to Vector 2022 on other pages)

How about "Welcome to a preview of the new design for Wikipedia!" or "Welcome to a sneak preview of the new design for Wikipedia!" I think people might also feel more special if they are getting a "sneak preview", and be more willing to give feedback.

great feedback @Pcoombe. I like mentioning "preview" or "sneak preview" as well. what do you think @ovasileva?

Olga let me know about the copy text. I'll look to enable this tomorrow.

I like "sneak preview" - it's a bit of a mouthful, but it works. Let's go with that! cc @Jdlrobson

Change 823587 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable new Vector skin on select pages

https://gerrit.wikimedia.org/r/823587

Change 824498 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[operations/mediawiki-config@master] Enable new Vector skin on select pages (take 2)

https://gerrit.wikimedia.org/r/824498

Mentioned in SAL (#wikimedia-operations) [2022-08-18T13:45:18Z] <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:823587|Enable new Vector skin on select pages (T314286)]] (duration: 03m 35s)

Change 824498 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable new Vector skin on select pages (take 2)

https://gerrit.wikimedia.org/r/824498

Mentioned in SAL (#wikimedia-operations) [2022-08-18T14:09:17Z] <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:824498|Enable new Vector skin on select pages (take 2) (T314286)]] (duration: 03m 07s)

T316401: Inconsistent theme on enwiki for IPs (some pages serve Vector 2022, some old Vector) was filed because the banner explaining this experiment as described in this task is not visible. Fixing that omission would reduce community confusion.

This will be turned off at 1pm today. I've restored the banners until then (to avoid further confusion). They should have been disabled together, but are managed by config/Central Notice respectively.