The very minor differences in counts across the different types of interactions with the Edit History Compare feature are a little weird:
| action | n_total_legacy_events | n_total_modern_events | percent_difference (new-old)/old |
|---|---|---|---|
| show_history | 2369 | 2309 | -2% |
| thank_fail | 15 | 15 | 0% |
| thank_success | 16 | 16 | 0% |
| revision_view | 4183 | 4127 | -1% |
| compare2 | 72 | 69 | -4% |
| thank_try | 57 | 57 | 0% |
| compare1 | 177 | 174 | -1% |
We need to investigate why the instrumentation (EditHistoryCompareFunnel.swift) produces fewer MEP events in some cases.
https://superset.wikimedia.org/superset/sqllab?savedQueryId=107
WITH user_event_counts_legacy AS ( SELECT event.app_install_id AS app_install_id, event.action AS action, COUNT(1) AS n_legacy_events FROM event.mobilewikiappiosedithistorycompare WHERE year = 2020 AND month = 9 AND day >= 16 AND useragent.os_family = 'iOS' AND useragent.wmf_app_version >= '6.7' GROUP BY event.app_install_id, event.action ), user_event_counts_modern AS ( SELECT app_install_id, action, COUNT(1) AS n_modern_events FROM event.ios_edit_history_compare WHERE year = 2020 AND month = 9 AND day >= 16 AND user_agent_map['os_family'] = 'iOS' AND user_agent_map['wmf_app_version'] >= '6.7' GROUP BY app_install_id, action ), user_event_counts_joined AS ( SELECT app_install_id, action, n_legacy_events, n_modern_events FROM user_event_counts_legacy AS legacy JOIN user_event_counts_modern AS modern USING (app_install_id, action) ) SELECT action, SUM(n_legacy_events) AS n_total_legacy_events, SUM(n_modern_events) AS n_total_modern_events, 100 * (SUM(n_modern_events) - SUM(n_legacy_events)) / SUM(n_legacy_events) AS percent_difference FROM user_event_counts_joined GROUP BY action;