Page MenuHomePhabricator
Create Task
Maniphest T134512

Wikipedia Portal survey: banner
Closed, ResolvedPublic
Actions

Assigned To
Jdrewniak
Authored By
debt
May 5 2016, 6:01 PM
Tags
Referenced Files
F4021327: Screen Shot 2016-05-16 at 5.31.22 PM.png
May 16 2016, 11:33 PM
F4021329: Screen Shot 2016-05-16 at 5.32.22 PM.png
May 16 2016, 11:33 PM
F3991787: survey-with-third-party-note_1.png
May 10 2016, 4:12 PM
F3970441: survey-with-third-party-note.png
May 5 2016, 6:01 PM
Subscribers
Aklapper
dchen
debt
gerritbot
• ggellerman
Jdrewniak
• JGirault
View All 9 Subscribers

Description

This task is to implement the banner that we'll need to have visitors to the portal click into the Qualtrics survey.

There is one button to go to the survey: https://wikimedia.qualtrics.com/SE/?SID=SV_bfTx7KXJbi0ulxj

and two links:

Wikipedia privacy statement https://www.wikimediafoundation.org/wiki/Wikipedia_Portal_Survey_Privacy_Statement

and

Qualtrics Privacy statement: https://www.qualtrics.com/privacy-statement/

Note: both privacy links should open up in a new tab in the visitor's browser.

We will put this banner in front of 1 in every 500 visitors to the site, using the existing EventLogging testing code logic.

survey-with-third-party-note_1.png (729×1 px, 150 KB)

Details

SubjectRepoBranchLines +/-
T134512 Bumping portals to master. Updating survey banner.operations/mediawiki-configmaster+1 -1
T134512 updating survey banner on wikipedia.orgoperations/mediawiki-configmaster+1 -1
T134512 updating survey banner on wikipedia.orgoperations/mediawiki-configmaster+1 -1
T134512 updating survey bannerwikimedia/portalsmaster+4 -4
T134512 adding survey banner to wikipedia.org portal.wikimedia/portalsmaster+326 -7
Customize query in gerrit

Related Objects
Search...

Event Timeline

debt created this task.May 5 2016, 6:01 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 5 2016, 6:01 PM
debt added a parent task: T129362: [EPIC} Create Survey to find out why some visitors don't interact with the Wikipedia.org Portal.May 5 2016, 6:02 PM
debt updated the task description. (Show Details)
debt moved this task from Backlog to What's Next on the Discovery-Portal-Sprint board.
debt updated the task description. (Show Details)May 5 2016, 6:09 PM
debt updated the task description. (Show Details)May 6 2016, 1:11 PM
Jdrewniak added a subscriber: mpopov.May 9 2016, 2:47 PM

Just to loop @mpopov in on this. We plan on showing this survey banner to 1 in 500 users. If some of these users fall into our 'baseline' event-logging bucket, their landing event will be logged, but their clickthrough on the banner won't be. This is because we don't have a 'survey-banner' clickthrough group in our schema.

In reality this shouldn't effect our dashboard analytics much, because the survey will only be live for ~24 hours, and we hope to get about 5-10k responses in that time.

However, if we want to avoid any anomalies to our dashboarding data, we could show this banner only to users in the 'rejected' event-logging group, so that they don't influence the dashboarding stats.

Does that sound like a good idea?

debt moved this task from What's Next to In Progress on the Discovery-Portal-Sprint board.May 9 2016, 9:44 PM
gerritbot subscribed.May 10 2016, 1:19 PM

Change 287947 had a related patch set uploaded (by Jdrewniak):
T134512 adding survey banner to wikipedia.org portal.

https://gerrit.wikimedia.org/r/287947

gerritbot added a project: Patch-For-Review.May 10 2016, 1:19 PM
debt updated the task description. (Show Details)May 10 2016, 4:12 PM
debt added a comment.May 10 2016, 4:16 PM

updating the banner image in the description to add in the word 'statement' and format it to be right aligned and on two lines.

debt moved this task from In Progress to Needs code review on the Discovery-Portal-Sprint board.May 10 2016, 4:55 PM
mpopov added a comment.May 10 2016, 6:57 PM
In T134512#2276280, @Jdrewniak wrote:

Just to loop @mpopov in on this. We plan on showing this survey banner to 1 in 500 users. If some of these users fall into our 'baseline' event-logging bucket, their landing event will be logged, but their clickthrough on the banner won't be. This is because we don't have a 'survey-banner' clickthrough group in our schema.

In reality this shouldn't effect our dashboard analytics much, because the survey will only be live for ~24 hours, and we hope to get about 5-10k responses in that time.

However, if we want to avoid any anomalies to our dashboarding data, we could show this banner only to users in the 'rejected' event-logging group, so that they don't influence the dashboarding stats.

Does that sound like a good idea?

I think we're fine. I'll just make a note about it, in case those numbers for that day don't fit the pattern.

gerritbot added a comment.May 10 2016, 9:25 PM

Change 287947 merged by jenkins-bot:
T134512 adding survey banner to wikipedia.org portal.

https://gerrit.wikimedia.org/r/287947

debt added a subscriber: • JGirault.EditedMay 10 2016, 10:57 PM

This has been merged into beta: http://www.wikipedia.beta.wmflabs.org/?new#survey-banner and is ready to be deployed tomorrow morning during the normal SWAT window.

Thanks, @JGirault !

debt moved this task from Needs code review to In Progress on the Discovery-Portal-Sprint board.May 10 2016, 10:58 PM
Jdrewniak moved this task from In Progress to Needs code review on the Discovery-Portal-Sprint board.May 11 2016, 1:42 PM
Jdrewniak moved this task from Needs code review to Done on the Discovery-Portal-Sprint board.
debt added a comment.May 11 2016, 6:36 PM

This was launched on May 11, 2016 during morning SWAT.

debt added a comment.May 11 2016, 7:20 PM

We are updating the selection of visitors that the survey is shown to - from 1 in 500 to 1 in 50 - due to only a limited amount of visitors viewing (and not completing) the survey.

gerritbot added a comment.May 11 2016, 7:26 PM

Change 288252 had a related patch set uploaded (by Jdrewniak):
T134512 updating survey banner

https://gerrit.wikimedia.org/r/288252

gerritbot added a comment.May 11 2016, 7:35 PM

Change 288252 merged by jenkins-bot:
T134512 updating survey banner

https://gerrit.wikimedia.org/r/288252

gerritbot added a comment.May 11 2016, 8:01 PM

Change 288258 had a related patch set uploaded (by Jdrewniak):
T134512 updating survey banner on wikipedia.org

https://gerrit.wikimedia.org/r/288258

gerritbot added a comment.May 11 2016, 9:23 PM

Change 288315 had a related patch set uploaded (by Jdrewniak):
T134512 bumping portals to master

https://gerrit.wikimedia.org/r/288315

gerritbot added a comment.May 11 2016, 9:26 PM

Change 288258 abandoned by Jdrewniak:
T134512 updating survey banner on wikipedia.org

https://gerrit.wikimedia.org/r/288258

gerritbot added a comment.May 11 2016, 11:06 PM

Change 288315 merged by jenkins-bot:
T134512 updating survey banner on wikipedia.org

https://gerrit.wikimedia.org/r/288315

debt added a comment.May 11 2016, 11:55 PM

This update went out during evening swat on May 11, 2016

• ggellerman added a subscriber: dchen.May 13 2016, 6:43 PM
• ggellerman subscribed.

+ Daisy

debt closed this task as Resolved.May 16 2016, 11:30 PM
debt added a comment.May 16 2016, 11:33 PM

The survey banner looked like this while it was in production:

Screen Shot 2016-05-16 at 5.31.22 PM.png (732×1 px, 157 KB)

Screen Shot 2016-05-16 at 5.32.22 PM.png (758×456 px, 144 KB)

gerritbot added a comment.May 17 2016, 8:43 AM

Change 289152 had a related patch set uploaded (by Jdrewniak):
Removing survey banner

https://gerrit.wikimedia.org/r/289152

gerritbot added a comment.May 17 2016, 2:39 PM

Change 289218 had a related patch set uploaded (by Jdrewniak):
T134512 Bumping portals to master. Updating survey banner.

https://gerrit.wikimedia.org/r/289218

gerritbot added a comment.May 17 2016, 3:09 PM

Change 289218 merged by jenkins-bot:
T134512 Bumping portals to master. Updating survey banner.

https://gerrit.wikimedia.org/r/289218

debt moved this task from Done to Completed on the Discovery-Portal-Sprint board.May 20 2016, 8:59 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL