Page MenuHomePhabricator

iOS native editing Data Validation
Closed, ResolvedPublic

Description

Task to validate data for iOS native edit events in release, editattemptstep and mediawiki_history

  • Beta data (7.4.7.3148)
  • Prod Data (7.4.7.3201)

Event Timeline

First pass Beta Data Validation: Event Tracking

Looks good - we are missing some edge case events that are hard to replicate in emulator, will keep an eye out (these are specialized save_failure with error info events for Talk Page edits, will not hinder my analysis. Will keep an eye out for events when release goes to prod.)

Verifying we are seeing edit interaction action data coming in to editattemptstep from Beta users, however I am not seeing any saveFailure values. All other event values are present in expected proportion.
@Tsevener let me know if this is as expected (ie saveFailure events not sent for reasons).
RESOLVED in Prod.

Also validating we see edit data and new event_comment values by revision_id in testwiki and enwiki revision dataset.

This comment was removed by SNowick_WMF.

Production Data Validation:
ios_edit_interaction data:
IN PROGRESS (all event values are present, waiting for a few outlier error/fail action_data values)

editattemptstep data:
PASS

enwiki revision data (event_comment values):
IN PROGRESS (waiting for #diff-undo which is a less frequent event)

Note:
All expected ios_edit_interaction action/active_interface events are firing but we are missing any results for action_data = abort_source: article_select_fail where action = edit_cancel and active_interface = article_edit_summary. Recording here so engineering / @Tsevener can take a look - it's possible this event just isn't happening. (We are seeing this same action_data value where active_interface = article_editing_interface).

Editattemptsep values and revision/mediawiki_history events are all verified. Prod Data Validation

@SNowick_WMF Good to know - I don't think article_select_fail from article_edit_summary is valid. edit_cancels from article_edit_summary only occur if they tap a blocked message link (which appears after they attempt to publish), which causes them to bail out of the editing flow. article_select_fail only occurs when we are unable to find their article text selection and scroll to it when the editor is displayed. It only should trigger when active_interface = article_editing_interface.

This is resolved, thank @Tsevener for the explanation, will change the event docs.