Task to validate data for iOS native edit events in release, editattemptstep and mediawiki_history
- Beta data (7.4.7.3148)
- Prod Data (7.4.7.3201)
Task to validate data for iOS native edit events in release, editattemptstep and mediawiki_history
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T344258 [Main Epic] 2023-2024 Enhancements to Editing on the iOS app | |||
| Resolved | None | T344282 [Sub Epic] Make the iOS editor native | |||
| Declined | JTannerWMF | T331937 [Task] iOS Analytics for full page editing | |||
| Resolved | SNowick_WMF | T357331 iOS native editing Data Validation |
First pass Beta Data Validation: Event Tracking
Looks good - we are missing some edge case events that are hard to replicate in emulator, will keep an eye out (these are specialized save_failure with error info events for Talk Page edits, will not hinder my analysis. Will keep an eye out for events when release goes to prod.)
Verifying we are seeing edit interaction action data coming in to editattemptstep from Beta users, however I am not seeing any saveFailure values. All other event values are present in expected proportion. RESOLVED in Prod.
@Tsevener let me know if this is as expected (ie saveFailure events not sent for reasons).
Also validating we see edit data and new event_comment values by revision_id in testwiki and enwiki revision dataset.
Production Data Validation:
ios_edit_interaction data:
IN PROGRESS (all event values are present, waiting for a few outlier error/fail action_data values)
editattemptstep data:
PASS
enwiki revision data (event_comment values):
IN PROGRESS (waiting for #diff-undo which is a less frequent event)
Note:
All expected ios_edit_interaction action/active_interface events are firing but we are missing any results for action_data = abort_source: article_select_fail where action = edit_cancel and active_interface = article_edit_summary. Recording here so engineering / @Tsevener can take a look - it's possible this event just isn't happening. (We are seeing this same action_data value where active_interface = article_editing_interface).
Editattemptsep values and revision/mediawiki_history events are all verified. Prod Data Validation
@SNowick_WMF Good to know - I don't think article_select_fail from article_edit_summary is valid. edit_cancels from article_edit_summary only occur if they tap a blocked message link (which appears after they attempt to publish), which causes them to bail out of the editing flow. article_select_fail only occurs when we are unable to find their article text selection and scroll to it when the editor is displayed. It only should trigger when active_interface = article_editing_interface.