Page MenuHomePhabricator

Update "ended" Light Engagement survey based on changes to ongoing variant
Closed, ResolvedPublic

Description

We made some wording changes to the "ongoing" variant of the light engagement survey. Some of those changes might also improve the "ended" survey, so we should evaluate that.

After reviewing both the "ended" and "ongoing"variants, we want to make these changes to the respective templates, which will affect all future surveys:

Changes to the "ended" survey:

"2. Please explain if there was anything you were expecting to get out of this engagement that you didn't?"
"3. Was there anything you got in this engagement with TPG that you weren't expecting?"
"5. Do you have any additional suggestions..."

Change to the "ongoing" survey:

"4. Do you think any improvements could be made..."

Event Timeline

JAufrecht renamed this task from Update main Engagement survey based on changes to ongoing variant to Update main Light Engagement survey based on changes to ongoing variant.Sep 28 2016, 6:07 PM
JAufrecht updated the task description. (Show Details)

@ksmith what is the engagement survey? @JAufrecht is retitling as this seems to be nested under LE epic

Should we remove Q1 tag in the interest of goal closeout? This feels like more of a maintenance task than something germane to the overall goal.

@KLans_WMF: This was related to T141142: Refine the Light Engagement survey based on 2nd round results so closing that one and keeping this one seems fine.

While the updates should have happened as part of the Q1 piloting stuff, they didn't. So I'm find detaching this from the Q1 goal. I'll do that now.

Comparing original vs. ongoing:

  • "2. Was there anything you were expecting to get out of this engagement that you didn't?" became "2. Please explain if there is anything you are expecting to get out of this engagement that you haven't yet and do not foresee getting?"
  • "3. Was there anything you got that you weren't expecting?" became "3. Is there anything you've gotten so far in this engagement with TPG that you weren't expecting?"
  • "4. Do you think improvements could be made..." became "4. Do you think any improvements need to be made..."
  • "5. Do you have suggestions for how TPG could improve..." became "5. Do you have any additional suggestions for how TPG could improve..."

I propose these changes to the original survey:

  • "2. Please explain if there was anything you were expecting to get out of this engagement that you didn't?"
  • ""3. Was there anything you got in this engagement with TPG that you weren't expecting?"
  • "5. Do you have any additional suggestions..."

I propose this change to the ongoing survey:

  • "4. Do you think any improvements should be made..."

Are you proposing that all four of these changes be made to the template and applied to all future surveys? If not, what does it mean to change the original survey but not the ongoing survey?

Yes, I am proposing 3 changes to our main template and one change to our ongoing variant template. "Original" was an unfortunate choice of words.

None of these changes are urgent, but I believe they should all be made once we have consensus about them.

@ksmith
Reviewed changes with @aripstra

for: 4. Do you think any improvements should be made..."

We think that "should" is prescriptive whereas "could" is more like a suggestion and less of a command

@ggellerman: Actually, the original said "could be", and the ongoing variant says "need to be". So my suggestion was already to soften it.

Personally I slightly prefer "should", because *any* change could be made, but I (as the survey-taker) only believe a few *should* be. But I'm OK having both flavors use "could", so let's restate suggestion 4 to be to change the ongoing survey:

"4. Do you think any improvements could be made..."

With that change, it sounds like we all agree. I will update the task description now. Should I make the changes to the survey form templates, or do you want to, or should @JAufrecht since this task is currently assigned to him?

ksmith renamed this task from Update main Light Engagement survey based on changes to ongoing variant to Update "ended" Light Engagement survey based on changes to ongoing variant.Nov 3 2016, 10:54 PM
ksmith updated the task description. (Show Details)

@ksmith @JAufrecht
I made the change in ques 4 in the ongoing survey template:

"Do you think any improvements could be made..."

Thanks @ggellerman.

@JAufrecht: Since this task is assigned to you, I'll assume for now that you'll update the "ended" (aka "main" aka "original") survey template with the other 3 changes. If you want me to do it, feel free to assign this task to me with a comment.

ksmith moved this task from In Progress to Needs Review on the Team-Practices (This-Week) board.

I believe this is done.

@JAufrecht or @ggellerman : Please sanity check my tweaks to the main LE survey questions 2, 3, and 5 (as proposed above).