Wed, Apr 26
Tue, Apr 25
Mon, Apr 24
Final draft updated on GitHub & uploaded to Commons: https://commons.wikimedia.org/wiki/File:Second_Test_Of_Cross-wiki_Search_-_Helping_More_Users_Discover_Content_On_Wikipedia%E2%80%99s_Sister_Projects.pdf
Fri, Apr 21
We're leaving this up on beta for a few more days just in case anyone discovers a major bug. If we don't hear of any problems, we'll deploy it to production at the beginning of next week.
2nd draft up now :) unless anyone objects, I'll upload the PDF to Commons on Monday
Thu, Apr 20
I deleted all the counts from 2017-02-18 onward (which is as far back as we would be able to backfill) and our pipeline is currently recounting the requests :) The annotation will be visible in production in the next round of dashboard deployments, but it's on beta now https://discovery-beta.wmflabs.org/wdqs/
Wed, Apr 19
Tue, Apr 18
Mon, Apr 17
I'd also recommend adding a "description" field that each report can have. Our config YAMLs have those (e.g. https://github.com/wikimedia/wikimedia-discovery-golden/blob/master/modules/metrics/external_traffic/config.yaml) and it's super useful for generating https://datasets.wikimedia.org/aggregate-datasets/discovery/README.md:
Thu, Apr 13
Up on beta: https://discovery-beta.wmflabs.org/external/
Wed, Apr 12
Tue, Apr 11
Fix is live in production. Thanks, @chelsyx!
Patch live on https://discovery-beta.wmflabs.org/portal/#all_country; still need to do thorough CR but everything looks OK from a quick glance
Fri, Apr 7
My acquaintance hasn't been able to find someone who works on that feature. There's nothing more we can do.
Okay, I fixed the problem described in the ticket: https://gerrit.wikimedia.org/r/#/c/347110/ but have no idea where to even start with fixing the full geo breakdown so I'm handing this back to Chelsy.
Wed, Apr 5
Live in production: https://discovery.wmflabs.org/metrics/#failure_breakdown
The patch is live on the testing space https://discovery-beta.wmflabs.org/metrics/ but playing around with it has revealed that maybe we should try consolidating the metrics that can be viewed on a language-project basis into a single tab on the dashboard. In the current implementation, the end user has to select a specific language-project combo (or combos, as the case may be) for each of the metrics individually and go back and forth between the tabs. It would be better UX to have to select the languages & projects once and then be able to quickly look at ZRR, CTR, PaulScore, etc. without leaving the tab.
Fri, Mar 31
Waiting for CR from @chelsyx (who's off today and won't be able to get to it until Monday), up on beta in the meantime: https://discovery-beta.wmflabs.org/metrics/#failure_breakdown
Ah, okay! Alrighty, we're also going to add the relative scale option to https://discovery.wmflabs.org/external/#traffic_summary
This is gonna take like 10 minutes at most so I'm just gonna bust this out real quick :)
Makes sense! However, we should keep it in the data just in case but hide on the graph and have a toggle for showing it again. That way it's still there if someone wants to see it (for diagnostics or whatever).
Thank you for looking into it, @dcausse!
Good job, @chelsyx!
Thu, Mar 30
Mar 27 2017
Mar 24 2017
I'll need to work with Mr. G on this one :)
Mar 23 2017
Everything is counted correctly by this script which uses the patched search request definition. Unfortunately we were used the pre-patch version until 2017-01-01 that undercounted API calls because it was not counting the 100M+ generator calls. I'm sorry that I didn't switch to using the latest refinery JARs sooner.
Taking a look…
Mar 21 2017
Revision uploaded. Thanks again, @ksmith!
Mar 20 2017
Note for future self: assertr 2.0 just released on CRAN. From http://www.onthelambda.com/2017/03/20/data-validation-with-the-assertr-package/:
Mar 17 2017
@ksmith I'll see if I can address some/all of those in a revision. Thanks!
Mar 16 2017
Updated the report following @debt's feedback. PDF version up on Commons: https://commons.wikimedia.org/wiki/File:A_Test_Of_Cross-wiki_Search_-_Helping_Users_Discover_Content_On_Wikipedia%E2%80%99s_Sister_Projects.pdf
Mar 15 2017
@debt, @TJones, @chelsyx, @ksmith thank you all for your feedback! Hopefully I've addressed it all in the second draft (web: https://wikimedia-research.github.io/Discovery-Search-Test-CrosswikiSidebar/, PDF: https://github.com/wikimedia-research/Discovery-Search-Test-CrosswikiSidebar/blob/master/docs/index.pdf) which now includes additional analysis per Kevin's curiosity :)
Mar 14 2017
Linking to the lintr package here for future reference: https://github.com/jimhester/lintr has instructions for configuring linters and adding it to Travis CI, which we could adapt to Jenkins when we get to it :)
Mar 10 2017
Mar 9 2017
Deployed to production: http://discovery.wmflabs.org/external/#traffic_summary
Deployed to production: http://discovery.wmflabs.org/portal/#sister_projects
Deployed to production: http://discovery.wmflabs.org/portal/#app_links
Deployed to production: http://discovery.wmflabs.org/wdqs/#endpoint_usage
stat1002:/a/discovery/golden has been updated
Mar 8 2017
Mar 1 2017
@Aklapper @debt: I'm OK with re-opening this ticket if @greg or someone can help us set it up. If we can get ortiz and wmf (which already have unit tests) to do CI checks on Gerrit, Chelsy and I can look into the other ones like polloi :)
Feb 28 2017
Feb 27 2017
This has been done:
Feb 21 2017
Getting mixed answers from my slow approach of using feature + digging for HTTP requests. Namely, Spotlight Suggestions within Safari web search seem to use Related Page + More Like API (thanks to @dcausse for his help), but Spotlight Suggestions from Spotlight search on Mac don't seem to make API calls. I just reached out to someone I know who works at Apple to possibly get me in touch with someone there who worked/works on that feature/team so that I could ask them about it directly. This ticket is paused until I hear back about that.
Feb 16 2017
Hm... seeing something that might indicate they're using our API :) looking deeper into it…