I'll make a start to this.

In terms of QA, for now we just want to verify that events are firing at different per the requirements on https://en.m.wikipedia.beta.wmflabs.org/w/index.php?title=T352930 when bucketed and when not bucketed (you have a 50% chance in an incognito window of either bucket).

You can surface events as a logged in user using the following code:

Please note the code might take some time to show up on beta cluster (hopefully will be there by 4 PST) to ensure the latest code is running on beta cluster.

mw.loader.using( 'mediawiki.api' ).then( function () {
  new mw.Api().saveOption( 'eventlogging-display-console', '1' );
} );

Status: ❌ FAIL
Environment: Beta
OS: macOS
Browser: Chrome
Device: MS

Test Steps

Test Case 1: Verify event fires for search session initiation

1. Open an incognito window and visit https://en.m.wikipedia.beta.wmflabs.org/w/index.php?title=T352930.
2. Log in to a user account.
3. Open the JavaScript console and execute:

mw.loader.using('mediawiki.api').then(function () {  
  new mw.Api().saveOption('eventlogging-display-console', '1');  
});

4. Ensure the search bar is visible.
5. Click on the empty search box.
6. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: init
• Action Subtype: init_search_box

7. ✅ AC1: Event fires when the empty search box appears.

{
    "action": "init",
    "font": "1",
    "is_full_width": false,
    "is_page_preview_on": true,
    "is_pinned": false,
    "is_media_viewer_enabled": true,
    "is_dark_mode_prepared_by_os": true,
    "dark_mode_setting": "0",
    "is_dark_mode_on": false,
    "action_context": "stable,amc",
    "viewport_size_bucket": "1000px-1199px",
    "action_source": "ns=0",
    "is_temp": false,
    "$schema": "/analytics/mediawiki/product_metrics/web_ui_actions/1.0.2",
    "page": {
        "namespace_id": 0
    },
    "performer": {
        "is_logged_in": true,
        "session_id": "74437b37345eed485156",
        "pageview_id": "97c1084208c94e4b5c03",
        "edit_count_bucket": "5-99 edits",
        "groups": [
            "*",
            "user",
            "autoconfirmed"
        ],
        "is_bot": false
    },
    "mediawiki": {
        "skin": "minerva",
        "database": "enwiki"
    },
    "agent": {
        "client_platform": "mediawiki_js",
        "client_platform_family": "mobile_browser"
    },
    "sample": {
        "rate": 1,
        "unit": "session"
    },
    "dt": "2025-01-30T01:35:59.206Z",
    "meta": {
        "stream": "mediawiki.web_ui_actions",
        "domain": "en.wikipedia.beta.wmflabs.org"
    }
}

Test Case 2: Verify event fires when user clicks on the empty search box

1. Follow Test Case 1 steps until step 4.
2. Click inside the search box.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: click
• Action Source: search_box

4. ❌ AC2: Event fires when the user clicks on the empty search box.

No action=click event fires when I click the search box

Test Case 3: Verify event fires when empty-state recommendations appear

1. Follow Test Case 1 steps until step 4.
2. Ensure that the empty-state recommendations appear in the search box dropdown.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: show
• Action Subtype: show_empty_state_recommendation

4. ❌AC3: Event fires when empty-state recommendations appear.

No action=show appears, or any new event appears.

Test Case 4: Verify event fires when user starts typing the first letter

1. Follow Test Case 1 steps until step 4.
2. Type a single letter in the search box.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: type
• Action Source: search_box

4. ❌AC4: Event fires when user types the first letter.

No action=type or any other event appears

Test Case 5: Verify event fires when type-ahead recommendations appear

1. Follow Test Case 4 steps until step 2.
2. Ensure that type-ahead recommendations appear in the search box dropdown.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: show
• Action Subtype: show_autocomplete_recommendation

4. ❌AC5: Event fires when type-ahead recommendations appear.

No action=show or any other event appears

Test Case 6: Verify event fires when user clicks on an empty-state recommendation

1. Follow Test Case 3 steps until step 2.
2. Click on one of the empty-state recommendations.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: click
• Action Source: empty_search_suggestion

4. ❌AC6: Event fires when user clicks on an empty-state recommendation.

No action=click event appears

Test Case 7: Verify event fires when user clicks on a type-ahead recommendation

1. Follow Test Case 5 steps until step 2.
2. Click on one of the type-ahead recommendations.
3. Verify that an event fires with:

• Event Name: mediawiki_web_ui_actions
• Action: click
• Action Source: autocomplete_search_suggestion

4. ❌AC7: Event fires when user clicks on a type-ahead recommendation.

No action=click event appears

@Jdlrobson-WMF , in general only the action=init event is appearing.

The init event is also a fail as we're looking for events to product_metrics.web_base.search_ab_test_clicks not mediawiki_web_ui_actions (have updated description to make that clearer)
The issue here is the configuration on beta cluster is wrong. We'll fix that next week and repeat QA as part of T385309.