I have a suspicion that it maybe related to sendBeacon. The analysis should only take the browsers that support this feature into account.

@bmansurov I re-ran all the above queries with userAgent LIKE '%Chrome/42%', and the ratios are all the same. I think there's something else at play here.

session-start: 9981
click-result: 523
distinct search tokens: 9983
impression-results: 4334

@bmansurov Just so I'm sure, does hitting enter in the search box count as a 'click-result' event?

@Deskana, if you're getting the similar results for Chrome, then this needs more investigation. As far as I know, hitting enter does trigger click-result. Browsing the search suggestions code, I noticed that there is also another callback used when the enter is hit. I'll try to find some time tomorrow to look into this.

@Deskana, I think the divisor needs to be the event_userSessionToken, not event_searchSessionToken:

> SELECT count(DISTINCT event_userSessionToken) FROM Search_11670541 WHERE timestamp >= 20150426000000 AND timestamp <= 20150427000000 AND wiki = 'enwiki' and userAgent LIKE '%Chrome/42%';
+----------------------------------------+
| count(DISTINCT event_userSessionToken) |
+----------------------------------------+
|                                   1169 |
+----------------------------------------+

> SELECT count(*) FROM Search_11670541 WHERE timestamp >= 20150426000000 AND timestamp <= 20150427000000 AND event_action = 'click-result' AND wiki = 'enwiki' and userAgent LIKE '%Chrome/42%';
+----------+
| count(*) |
+----------+
|      523 |
+----------+

Nonetheless, while approximately 44% clickthrough rate alone seems conceivable, the "do-something" ratio seems like it should be higher.

@bmansurov, my recommendation would be to add an onFormSubmit type action that captures clicks/taps on the magnifying glass icon or entry of the ENTER/RETURN key. It may make sense to try capturing both types of events if possible, and then assign new and different event_action values to each (failing that, just create another type of event_action of something like 'form-submitted')...this will require a schema rev and corresponding code file update. @Deskana, one new event type or two? Or just bundle them into the "click-result" event_action?

In T97310#1240490, @dr0ptp4kt wrote:

@Deskana, I think the divisor needs to be the event_userSessionToken, not event_searchSessionToken:

For now that's fine, but it is indicative that there's either something wrong in the implementation or that the rows in the schema are named incorrectly. I need to get this running in a test instance and audit whether the collection matches my expectations as the data analyst.

For now that's fine, but it is indicative that there's either something wrong in the implementation or that the rows in the schema are named incorrectly. I need to get this running in a test instance and audit whether the collection matches my expectations as the data analyst.

Agreed.

Change 207262 had a related patch set uploaded (by Bmansurov):
Track the skin provided search box form submission

https://gerrit.wikimedia.org/r/207262

Change 207263 had a related patch set uploaded (by Bmansurov):
Track the 'form-submit' event

https://gerrit.wikimedia.org/r/207263

Above are two patches that track the form submission. I didn't differentiate between hitting the Enter key and clicking on the magnifying glass. Let me know if I should.

Change 207262 merged by jenkins-bot:
mediawiki.searchSuggest: Add track event on search form submission

https://gerrit.wikimedia.org/r/207262

@Krinkle merged:

mediawiki.searchSuggest: Add track event on search form submission
https://gerrit.wikimedia.org/r/207262

Note that form submission still leaves ambiguity over two things:

• The user may or may not have selected a suggestion from the list. (The input field may either contain the user's input, or a a selected page title).
• The user may or may not end up on the search result page after form submission (if the user entered or selected a title, form submission will redirect to that page title directly instead of showing search results).

• https://gerrit.wikimedia.org/r/207262 (branch master): MW-1.26-release, WMF-deploy-2015-06-09_(1.26wmf9)

Change 207263 merged by jenkins-bot:
Track the 'submit-form' event

https://gerrit.wikimedia.org/r/207263