Closing this as resolved as this work is basically completed. If we need additional changes or follow ups, @MMiller_WMF can either reopen this or file a new task.
Thu, Feb 25
@kostajh : I think we can decline this. The second question seems to have been answered by the work we've done with improving performance. As for the first one, I think that's for @MMiller_WMF to decide. I think it would be quick to get an estimate of what that proportion is, but I'm also not sure it's something we're particularly concerned about.
From the analytics perspective, I think there's three things we need to consider:
Wed, Feb 24
I went through our measurement specifications, the Newcomer Tasks reporting notebook, and also considered what data we use for various analysis. This change should cause us no problems.
@CBogen and @mwilliams : Could you both read through the task description and correct things and check boxes where needed? I'm unsure who'll be the manager signing off on this, but I'm sure you can figure that out :)
Tue, Feb 23
@mforns : Sure thing! Sorry about the confusion, once I noticed that the parent task was set to the one that I created to summarize all the EventLogging-related work it made sense why this would look like another task for someone from AE to work on.
Moving this to the Analytics Radar, for the same reasons as I just moved T275172. This is for a Growth engineer to pick up once the child task has progressed enough for the window to be shorted.
Moving this to the Analytics radar and reassigning to me. The Welcome Survey aggregation needs to be streamlined and set up for monthly updates, and this task is for me to get that done. I also changed the parent task to T275171, which is the task for the Growth engineers to pick up when the aggregation is done and we can safely shorten the window.
Thu, Feb 18
Wed, Feb 17
Tue, Feb 16
I'm reopening this task as we've now got visualizations/dashboards in Superset that @CBogen needs access to, and these require the group membership requested in this task.
Thu, Feb 11
I think I'd like to draw up some different scenarios (using images as the example media) and go through what edit tags end up getting applied, just to make sure I've got this right.
Wed, Feb 10
Tue, Feb 9
I updated the task description to make the ask clear. I've also updated the description of the parent task to make it clearer what we're looking to do, and create a new child task for the part that didn't already have one. Hopefully this makes everything less confusing, but please let me know if it didn't and I'll do my best to help out!
@fdans : The parent task asks to revert the changes made in T237124. There's also the second child task, T273826, for updating the whitelist. Once those two are completed, we can delete the associated four tables in event_sanitized, which is what this task is about. I'll update the task description to reflect that specific ask. I see now that all of this hasn't been very clear, maybe I should make a new parent task that lays all of this out and mentions all of the child tasks in the description?
Sat, Feb 6
Thu, Feb 4
This has been completed, here's the update I gave to Connie, Kate, and Marshall in preparation for the Q2 Tuning Session:
Wed, Feb 3
The first two parts of this is done and the rough draft is shared with Marshall.
Jan 28 2021
@CBogen and I discussed this in our sync meeting today, as reflected in the updated task description. I've added T258834 as a subtask of this one, because having the SDC data queryable in the Data Lake will help us answer key questions about the richness of it.
Jan 26 2021
Jan 25 2021
The survey has completed and the code has been removed. We've gathered the data and analyzed it, finding mixed results. The team is working on following up this to gather feedback from other user groups. As far as I can tell, this task can be resolved.
Jan 23 2021
This is no longer blocked as the instrumentation is deployed.
The goal of this task is unclear, which makes it difficult to prioritize it. If we are to undertake this work, we need to know more about how building this dashboard will help inform the org or drive decisions. This is partly because there's already tracking of the number of files with at least one structured data element (T238878#5692516, productionized in T239565, see also T247101), which arguably tracks the growth of SDC. For now, I'll move this to the upcoming quarter for a future revisit.
It's unclear when we can make this a priority. Moving it to the upcoming quarter for now.
Jan 19 2021
Discovered this was stuck in the PA team's tracking category. Moved to kanban and into "doing" as I'm about to grab the data.
Jan 14 2021
Jan 13 2021
Jan 12 2021
I've resolved all the issues we had with the earlier draft of the notebook and handed it back to Marshall for testing and feedback.
Jan 11 2021
Moving this into the current quarter on the Product Analytics board since I'll be chatting with @Miriam about this some time soon.
Jan 5 2021
Jan 4 2021
Dec 23 2020
Dec 22 2020
This analysis is now ready for review. I've uploaded the notebook with the analysis to GitHub.
All the notebooks related to this analysis are now in the Growth homepage repository. The filenames all start with the task number of this phab task.
Dec 21 2020
The draft report now includes analysis of all questions, including the proportion of users who view the full newcomer tasks module on mobile. It also has similar measurements from the Variant A/B experiment analysis for comparison. Handing this task off to @MMiller_WMF for final review and sign off while I go review all the notebooks and put them on GitHub.