This is to wire up instrumentation into the Hybrid Search prototype and a/b/c test.
Instrumentation plan:
https://docs.google.com/presentation/d/1la0CFGVbwmu7fTBS5uYgnlgkCoho_agrVKEVTlyZKMw/edit?usp=sharing
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T412856 Hybrid (Semantic + Lexical) Search MVP on Android | |||
| Open | SNowick_WMF | T410806 Instrumentation Needs Assessment & Event/Property Rewrite for Hybrid Search MVP | |||
| Resolved | cooltey | T417662 Instrumentation for Hybrid Search |
Event Timeline
Comment Actions
Hi @ABorbaWMF
The stream name for this instrumentation is product_metrics.app_base
Go to Developer settings, find Event Platform intake base URI and set it to Beta
Please note the Event platform batch size variable does not work here.
Event stream: https://stream.wikimedia.beta.wmcloud.org/v2/ui/#/?streams=product_metrics.app_base
Test groups
0 = Control
1 = Lexical Semantic
2 = Semantic Lexical
How to see the events?
We used TestKitchen for the instrumentation this time, and the app will send out the events after the search screen is closed/paused.
For example, if you want to see action=show_hybrid_result, after entering the semantic search results screen, you can simply click on the back button from the toolbar, and you will see the events pop up in the EventStreams website.