Using statistical analysis, Bayesian inference, machine learning, and software/data engineering to solve problems and inform decisions in Product Analytics
Thu, Jul 2
mobile-html requests are now counted as pageviews
Tue, Jun 30
need feedback from @SNowick_WMF's conversations with apps PMs
The bug report template asks for python stacktraces from superset logs, which I don't have access to. I pinged @elukey on the issue, maybe he can provide the necessary info?
Mon, Jun 29
In our sync with AE we did talk about the volume of data and computational + labor/time costs of such an undertaking. First and foremost our teams' priority is to get the updated definition deployed so those requests can start getting counted correctly.
Fri, Jun 26
Thu, Jun 25
Wed, Jun 24
Heads-up @Ottomata re: search satisfaction port to MEP. Should this field be added to the legacy schema or the modern schema or both for parity?
That's fair, plus THE use case for this feature is Growth team's experiments and their issues with EditAttemptStep.
@Ottomata: do you think we can incorporate that algorithm into EventLogging in a way that the cc map isn't generated client-side on every pageload? If I write the PHP version, can we put it in EventLoggingHooks.php similar to loadEventStreamConfigs? It would generate the map from $config->get( 'EventLoggingStreamNames' ) and make it available client-side as config.streamCCMap (or something like that).
Tue, Jun 23
Mon, Jun 22
Seeing as we've considered it and have come to the conclusion in March that nothing more needs to be done, we can close this out.
@elukey: so who needs to do what? it looks like SRE needs to review sudo request for the system user before the system user can be added?
It can be removed manually in Superset (and has been for some datasets), but not sure if it gets automatically re-added when new data is ingested or when there are updates to those datasets.
Tue, Jun 16
Mon, Jun 15
Hm… maybe user, page, and ui would be better as separate fragments, rather than together in one fragment
Fri, Jun 12
Thu, Jun 11
@Ottomata: unless I'm mistaken your port of search satisfaction to MEP is the only way we have of seeing how this is working in production, right?
Wed, Jun 10
Pull request for review: https://github.com/wikimedia/wikipedia-ios/pull/3603
Tue, Jun 9
Mon, Jun 8
I don't think this should be done manually by hand because we'd need to remember to set up the folders if a new stat node is added. So I think Puppet is the way to go here. I'm happy to make the necessary patches but I've found it really hard to keep track of / fully grasp which roles and profiles are applied to the stat hosts. I have some notes here: meta:User:MPopov (WMF)/Notes/DevOps#Puppet but they're not as detailed as I'd like.
Jun 5 2020
@Dbrant: The app version doesn't look right to me, does it look right to you?
@Ottomata @MarcoAurelio: I can't access that logstash site so I have no idea which of the two apps has faulty instrumentation (could even be both, also I assume there's useragent info with the errors)
For testing in MediaWiki Vagrant, I had the following to LocalSettings.php:
Jun 3 2020
Done! @nettrom_WMF: all good to go on stat1005 and stat1008! On other hosts the older version (0.6.0) needs to be manually installed due to R 3.3. Instructions over at: https://meta.wikimedia.org/wiki/User:MPopov_(WMF)/Notes/Setup#hrbrthemes
Everything went fine installing systemfonts (after patch), gdtools, and hrbrthemes on stat1005, but we're missing libcairo2-dev package on stat1008:
Jun 2 2020
This is done
Jun 1 2020
I've reached out to @spatton on Slack about this.