Page MenuHomePhabricator

Measure time to first click in the search satisfaction schema
Closed, DeclinedPublic

Description

It would be nice to know how long the user spends between receiving their search result and clicking through to a result. It might give some indication to the quality of the results, users clicking through faster saw what they were looking for immediately, while users taking longer might indicate they scroll through the results, consider a few options, then click one that is maybe kinda/sorta the right answer (or not).

Collecting these in javascript might get harder, it would be nice if we had a way to collect this information from the webrequest logs directly. This might tie into the previous idea of giving each search a unique hash, and having click through's from search hit a redirect bounce that includes tracking information and then redirects them on to their final result. We can't necesarrily include these extra tracking parameters in the link to the article itself because that would hurt article cache hit rates (unless we stuff all the data into wprov somehow)

Related Objects

Event Timeline

EBernhardson raised the priority of this task from to Needs Triage.
EBernhardson updated the task description. (Show Details)
EBernhardson subscribed.

Thinking about this more, we actually may already be able to extract it from the existing search satisfaction schema. We can order the events by searchSessionId and measure the difference between first searchResultPage event and the first visitPage event.

Thinking about this more, we actually may already be able to extract it from the existing search satisfaction schema. We can order the events by searchSessionId and measure the difference between first searchResultPage event and the first visitPage event.

The timestamp recorded by EventLogging records the time that the event was received by EventLogging (which is subject to random fluctuations in latency), rather than the time as perceived by the client; a code change would be required to record the latter. I'd personally prefer to make that code change, so that we're more sure that the data we're receiving represents things how users perceive it. Thoughts?

Aklapper removed a project: Discovery-ARCHIVED.
Gehel subscribed.

Current definition of Search SLO is in T335576. We might revisit this as part of a deeper effort.