Page MenuHomePhabricator

QA IP Info schema instrumentation on testwiki and production
Closed, ResolvedPublic

Description

Motivation

IP Info has been deployed and its instrumentation config (T304438) are currently deployed to testwiki. We want to make sure that the instrumentation is complete per the schema and that all the data is coming through.
The full production deploy will happen on the 19th of May.

The instrumentation spec has been defined in this document.

Instrumentation Note

Related events will be recorded in event.mediawiki_ipinfo_interaction.
Sample rate: 100%

To DO

  • Schema QA on test wiki
  • Schema QA on production

QA Summary

  • Schema QA on test wiki

QA summary on test wiki by 2022-05-09

What has been checkedStatusNote
wiki✅ passonly testwiki
event_action❓Not all types of events are available in schema6 types of events are captured: init_disclaimer, expand, collapse, close_disclaimer, uncheck_iagree, disable_ipinfo
event_context❓Not all types of events are available in schema2 types of context are captured: infobox, page
event_source❓Not all types of events are available in schema2 types of source are captured: special_preferences , special_contributions
user_EditBucket✅ passrecorded
user_groups✅ passrecorded
event_ipinfo_version❌ not recordedNull
date✅ pass6 events in total by 2022-05-09. 6 events are between 2022-05-05 and 2022-05-06
  • Schema QA on production

QA summary on test wiki by 2022-06-09

What has been checkedStatusNote
wiki✅ passproduction wikis
event_action✅ some naming changes. Confirmed with engineer14 types of events are captured: accept_disclaimer, click_help_connection_method, click_help_connection_owner, click_help_proxy, close_disclaimer, collapse , copy, disable_ipinfo, enable_ipinfo, expand, init_disclaimer, open_infobox, open_popup, uncheck_iagree
event_context✅ some naming changes. Confirmed with engineer4 types of context are captured: infobox, page, ip_address, popup
event_source✅ some naming changes. Confirmed with engineer6 types of source are captured: special_preferences , special_contributions, action_history, special_log, special_watchlist, special_recentchanges
user_EditBucket✅ passrecorded
user_groups✅ passrecorded
event_ipinfo_version✅ passbasic or full or Null
date✅ passevents available on production since 2022-05-24

Event Timeline

Niharika triaged this task as Medium priority.Apr 15 2022, 10:54 PM
Niharika created this task.
Niharika renamed this task from QA IP Info schema instrumentation on testwiki to QA IP Info schema instrumentation on testwiki and production .May 10 2022, 6:35 PM
Niharika updated the task description. (Show Details)

@Niharika

Here is the QA summary on test wiki by 2022-05-09.

What has been checkedStatusNote
wiki✅ passonly testwiki
event_action❓Not all types of events are available in schema6 types of events are captured: init_disclaimer, expand, collapse, close_disclaimer, uncheck_iagree, disable_ipinfo
event_context❓Not all types of events are available in schema2 types of context are captured: infobox, page
event_source❓Not all types of events are available in schema2 types of source are captured: special_preferences , special_contributions
user_EditBucket✅ passrecorded
user_groups✅ passrecorded
event_ipinfo_version❌ not recordedNull
date✅ pass6 events in total by 2022-05-09. 6 events are between 2022-05-05 and 2022-05-06
jwang updated the task description. (Show Details)

@Niharika, here is summary of production schema QA. The events are available on product as the functional spec defined. It seems there are some naming changes. I commented in spec Col F (Discussion/Notes). Please review and confirm for the purpose of documentation.

  • Schema QA on production

QA summary on test wiki by 2022-06-09

What has been checkedStatusNote
wiki✅ passproduction wikis
event_action❓some naming changes. To confirm with engineer14 types of events are captured: accept_disclaimer, click_help_connection_method, click_help_connection_owner, click_help_proxy, close_disclaimer, collapse , copy, disable_ipinfo, enable_ipinfo, expand, init_disclaimer, open_infobox, open_popup, uncheck_iagree
event_context❓some naming changes. To confirm with engineer4 types of context are captured: infobox, page, ip_address, popup
event_source❓some naming changes. To confirm with engineer6 types of source are captured: special_preferences , special_contributions, action_history, special_log, special_watchlist, special_recentchanges
user_EditBucket✅ passrecorded
user_groups✅ passrecorded
event_ipinfo_version✅ passbasic or full or Null
date✅ passevents available on production since 2022-05-24

It seems there are some naming changes. I commented in spec Col F (Discussion/Notes). Please review and confirm for the purpose of documentation.

@Tchanders, Can you review and confirm? (func spec)

jwang updated the task description. (Show Details)

Have confirmed with engineer on the name changes and updated func spec.