I did a quick check of the current data coming in and number of events. It looks good from my side. Some instrumentation errors are is being addressed in another task. I'll go ahead and close this one.
Fri, Sep 13
Sorry for the delay! Below is a summary of the results. Link to full analysis. My ability to answer some of the questions was limited based on available data and instrumentation but I tried to substitute other options where possible.
Thu, Sep 12
Mon, Sep 9
I discussed this task with @Neil_P._Quinn_WMF today. See current proposed plan and thoughts below and let me know if you have any other suggestions.
Fri, Sep 6
I spent a little time digging into the data that occurs around some of the event spikes. I specifically looked at the spikes seen at 2019-08-20 on 12:00pm and 2019-09-04 at 17:30pm.
Thu, Sep 5
Tue, Sep 3
Tue, Aug 27
I finished pulling the active editor sample with the specified changes. Updated code repo.
Fri, Aug 23
Thu, Aug 22
Thanks @Mayakp.wiki! Just following up to confirm I verified that the content page edit counts issue count looks like it has been fixed. Current notebook with analysis.
Wed, Aug 21
Paired with @Neil_P._Quinn_WMF to confirm that the additional logging events are being logged correctly. We see the close context events starting at the end of July as expected for a variety of features.
@MNeisler is 10% sampling rate for you ok? Do you want to go higher?
Fri, Aug 16
Aug 15 2019
Aug 13 2019
I paired with @cchen on Friday to complete calculation of the Readers July metrics. Updated numbers and draft analysis notes added to the current staging deck template.
Aug 9 2019
Aug 8 2019
Here is a current summary of findings after looking into this the past couple days:
Aug 6 2019
Aug 5 2019
For reference, here are the two IE corrections currently applied when calculating the monthly pageviews for the board metrics.
I agree that leaving the tag as is (Option #1) makes the most sense given the complexity and potential issues that might arise with the other options.
Aug 2 2019
We're waiting on go ahead from @MNeisler that this is okay this can move to todo. We're shipping unnecessary code to users so best to remove that as early as possible.
Aug 1 2019
A few quick checks of the current data:
Jul 31 2019
Jul 30 2019
@MNeisler do we want to enable the schema on production with sampling rate 50% ?
Jul 29 2019
Jul 26 2019
Jul 25 2019
I hashed any tokens or temporary identifiers for the following three active Web EventLogging schemas on the whitelist:
Jul 24 2019
Jul 23 2019
I made some small edits to indicate the date when the mobile web and amc tags were added to action in the log table and did some final report cleanup. There are no changes to the numbers previously reported. Please see final report. Let me know if you have any questions.
Jul 19 2019
@MNeisler just to be sure. We pass mode as a comma separated string, for example: beta,amc. Does the order matter for you? is there any difference if we pass amc,beta because of some reason?
It's not a problem for now - now it will be strictly defined set of possible values and order - just a question for future once we might start adding new modes.
Jul 18 2019
@ovasileva Here's the current report of the AMC KPIs. Let me know if you have any questions or need any additional info/adjustments for next week's Product meeting.
Jul 16 2019
@pmiazga - As discussed during standup, I agree we should replace userEditCount with editCountBucket (with the values you listed) so it's better suited for druid ingestion if we want the data available in Turnilo. Thanks for catching that!
Jul 15 2019
@ovasileva: Quick question- For the mobile edit rate and moderation action metrics, would you like to look at the overall rate across all target wikis identified for the project as defined here or just across all of the target wikis where AMC has been deployed to date for this report?
Jul 12 2019
Jul 11 2019
@pmiazga - I like the proposed name change: MobileWebUIActionsTracking
Jul 10 2019
Calculations for June 2019 complete. I've added my notes/analysis to the board deck.
Jul 9 2019
Jun 28 2019
Jun 26 2019
@kzimmerman Discussed this with Olga. The team has currently been using a Turnilo board to track the retention rate for opt-in advanced mobile mode users. I've added a link to the mediawiki page.
Jun 25 2019
Jun 13 2019
How many users use the "group" option as a user preference?
Jun 11 2019
@kzimmerman I've completed calculating May 2019 metrics and added the updated numbers and analysis notes to the board deck.
Jun 10 2019
Jun 5 2019
@phuedx - Do you know which user property controls the "group" preference for this question?
How frequently do users use the "group" option either as a filter or as a user preference? priority high
Jun 3 2019
I discussed the sampling rate for this with the Product Analytics team. Since all the eventlogging data was moved to Hadoop, there are fewer concerns about sending too much data from the Analytics Engineering side. Unless there are other concerns (happy to discuss), I think it's ok if we keep the sampling rate to 50% for navigation links outside the hamburger menu as well.
May 31 2019
Good news! I figured out access to the user properties table. I'll work on the questions that require info in this table starting with the following one marked as high priority:
How many users have enabled enhanced RC?
How frequently do users use the "group" option either as a filter or as a user preference?
May 30 2019
May 29 2019
May 28 2019
May 21 2019
Awesome, thanks @mforns! Looks good. Just a few questions/comments: