Migrate MobileWikiAppiOSEditHistoryCompare schema to MEP
Closed, ResolvedPublic
Actions

Description

Unlike the work that was done to migrate SearchSatisfaction schema from legacy to modern, migrating MobileWikiAppiOSEditHistoryCompare will require creating a new schema (and then stream) in schemas/event/secondary.

It should reference the core identifiers fragment and list device_id and session_id in required, which are filled-in by EPC library. It will have an action enum, a primary_language string, and an is_anon boolean which are filled-in by instrumentation.

Proposed schema name: /analytics/mobile_app/ios/edit_history_compare
Proposed stream name: ios.edit_history_compare

Details

	Subject	Repo	Branch	Lines +/-
	wgEventStreams: Stream for MEP-iOS pilot	operations/mediawiki-config	master	+5 -1
	Create iOS Edit History Compare schema	schemas/event/secondary	master	+402 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Declined	None	T259734 BUOD-KR1-Q4+: Certify that analytics schema and instruments have been upgraded to use the MEP system (clearing the legacy system for sunsetting)
Declined	Ottomata	T259157 BUOD-KR1-Q3: Require that all new schema/instruments are created with the MEP system
Declined	None	T259704 BUOD-KR1-Q2: Upgrade MEP clients to full release status
Resolved	kzimmerman	T259169 BUOD-KR1-Q1: Pilot MEP clients with 2 product teams
Resolved	mpopov	T259709 MEP instrument/schema pilot #1 (EditHistoryCompare)
Duplicate	None	T259839 Convert one iOS schema to new MEP system
Resolved	mpopov	T260382 Migrate MobileWikiAppiOSEditHistoryCompare schema to MEP

Event Timeline

mpopov created this task.Aug 13 2020, 6:27 PM

mpopov moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.

mpopov updated the task description. (Show Details)Aug 13 2020, 6:30 PM

LGoto triaged this task as Medium priority.Aug 13 2020, 7:13 PM

LGoto moved this task from Tasks from Product Backlog to Needs Acceptance Criteria on the iOS-app-v6.7-Bonefish-On-A-Bus board.

@SNowick_WMF: what do you think about this schema being in an /analytics/mobile_app/ios/ directory (e.g. /analytics/mobile_app/ios/edit_history_compare)? (to not bloat the /analytics/mobile_app directory) We can even go one level deeper and have it be /analytics/mobile_app/ios/edit/history_compare, with the intention of putting other editing-related schemas under /analytics/mobile_app/ios/edit/

LGoto moved this task from Needs Triage to Engineering Backlog on the Wikipedia-iOS-App-Backlog board.Aug 17 2020, 6:48 PM

• jlinehan added a project: Product-Data-Infrastructure.Aug 19 2020, 5:50 PM

mpopov updated the task description. (Show Details)Aug 21 2020, 6:14 PM

Change 622137 had a related patch set uploaded (by Bearloga; owner: Bearloga):
[schemas/event/secondary@master] Create iOS Edit History Compare schema

https://gerrit.wikimedia.org/r/622137

gerritbot added a project: Patch-For-Review.Aug 24 2020, 12:39 PM

mpopov moved this task from Inbox to Doing on the Product-Data-Infrastructure board.Aug 24 2020, 3:12 PM

Change 622137 merged by Bearloga:
[schemas/event/secondary@master] Create iOS Edit History Compare schema

https://gerrit.wikimedia.org/r/622137

Change 623048 had a related patch set uploaded (by Bearloga; owner: Bearloga):
[operations/mediawiki-config@master] wgEventStreams: Stream for MEP-iOS pilot

https://gerrit.wikimedia.org/r/623048

Change 623048 merged by jenkins-bot:
[operations/mediawiki-config@master] wgEventStreams: Stream for MEP-iOS pilot

https://gerrit.wikimedia.org/r/623048

Mentioned in SAL (#wikimedia-operations) [2020-08-31T18:11:00Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 846c5448f950b4d0d7eedce570e46d74ca62ca38: wgEventStreams: Stream for MEP-iOS pilot (T260382) (duration: 00m 55s)

Maintenance_bot removed a project: Patch-For-Review.Aug 31 2020, 6:11 PM

$ curl -s 'https://meta.wikimedia.org/w/api.php?action=streamconfigs&format=json&constraints=destination_event_service=eventgate-analytics-external' | jq .
{
  "streams": {
    "eventlogging_SearchSatisfaction": [],
    "eventlogging_TemplateWizard": [],
    "eventlogging_Test": [],
    "test.instrumentation": [],
    "test.instrumentation.sampled": {
      "sampling": {
        "rate": 0.5
      }
    },
    "ios.edit_history_compare": [],
    "eventgate-analytics-external.test.event": [],
    "eventgate-analytics-external.error.validation": []
  }
}

Verified that events produced to ios.edit_history_compare stream ended up in ios_edit_history_compare table.

@mpopov I think we are ok without the extra edit subdirectory for now, we have a few schemas that combine editing with other data I wouldn't want to get lost. Let's go with /analytics/mobile_app/ios/edit_history_compare

The schema is already /analytics/mobile_apps/ios_edit_history_compare, plus we decided to use /[platform]_[feature] instead of /[platform]/[feature]

Migrate MobileWikiAppiOSEditHistoryCompare schema to MEPClosed, ResolvedPublicActions

Description

Details

Related ObjectsSearch...

Event Timeline

Migrate MobileWikiAppiOSEditHistoryCompare schema to MEP
Closed, ResolvedPublic
Actions

Related Objects
Search...