BUOD-KR1-Q3: Require that all new schema/instruments are created with the MEP system
Closed, DeclinedPublic
Actions

Description

Relation to department goals

This task tracks the Better Use of Data working group's Q3 work for KR1 of its FY 2020-2021 OKR.

Objective: Foundation staff can better access and interpret production user data to identify areas of opportunity and make data-informed decisions to advance our MTP.
KR1: Obtain commitment from 100% of product teams to use the MEP and clients for new tracking (by end of Q3) ...

Description

This task is essentially for tracking work that will allow us to build consensus among product teams and feel confident in announcing this guidance. The nature of this goal is less tangible than other goals, as it requires us mostly to understand needs and service expectations of product teams, build trust and confidence in our software, and ensure an appropriate level of training and documentation is available for teams.

Note that this task does NOT mean that all instrumentation or schema are using the new system. Rather that all NEW instrumentation or schema are to use the new system.

Related Objects
Search...

Status	Subtype	Assigned	Task
Declined		None	T259734 BUOD-KR1-Q4+: Certify that analytics schema and instruments have been upgraded to use the MEP system (clearing the legacy system for sunsetting)
Declined		Ottomata	T259157 BUOD-KR1-Q3: Require that all new schema/instruments are created with the MEP system
Resolved		Ottomata	T238837 Develop test environment solution for MEP analytics events
Resolved		Ottomata	T187102 Vagrant's /var/log/daemon.log filling up with kafka errors
Resolved		Ottomata	T259155 Obtain evidence-based guidance on capacity for event streams
Open		None	T259373 Develop strategy for mitigating degenerate client timestamps in event data
Declined		None	T259704 BUOD-KR1-Q2: Upgrade MEP clients to full release status
Resolved		Ottomata	T240462 Review and evolve client environment around EventLogging
Resolved		• jlinehan	T240454 Consider how to best architect transmission of events from Browser Client
Resolved		mpopov	T240452 Consider simplifying EventLogging dependency on mw.user's random ID generation
Resolved		• jlinehan	T240461 Clients may need to generate a UUID for sending events.
Resolved		• jlinehan	T240460 Clients need to generate an ISO 8601 formatted timestamp
Open		None	T267648 Adopt conventions for server receive and client/event timestamps in non analytics event schemas
Resolved		Ottomata	T330918 Add event dt field to error event schema
Resolved		mpopov	T251281 Clients may need to set wiki/domain/webHost in event metadata
Declined		mpopov	T255302 Schema fragment for fields common to product analytics
Declined		mpopov	T259077 Review schema fragments
Declined		SNowick_WMF	T259750 Review schema fragments (Shay)
Resolved		SNowick_WMF	T259747 Review identifiers schema fragment (Shay)
Declined		nettrom_WMF	T259751 Review schema fragments (Morten)
Resolved		nettrom_WMF	T259748 Review identifiers schema fragment (Morten)
Declined		nshahquinn-wmf	T259752 Review schema fragments (Neil)
Resolved		nshahquinn-wmf	T259749 Review identifiers schema fragment (Neil)
Declined		MNeisler	T259753 Review schema fragments (Megan)
Declined		jwang	T259754 Review schema fragments (Jennifer)
Resolved		kzimmerman	T259169 BUOD-KR1-Q1: Pilot MEP clients with 2 product teams
Resolved		mpopov	T259709 MEP instrument/schema pilot #1 (EditHistoryCompare)
Resolved		mpopov	T228180 MEP Client iOS (MVP)
Resolved		Tsevener	T258228 Investigate integrating MEP library in iOS
Resolved		Tsevener	T259271 Implement NetworkManager in MEP
Resolved		mpopov	T259714 Test schema and stream for analytics events
Resolved	BUG REPORT	• Mholloway	T259917 Streams with empty configs should be rendered as {} in the JSON returned by StreamConfig API
Duplicate		None	T259839 Convert one iOS schema to new MEP system
Resolved		mpopov	T260382 Migrate MobileWikiAppiOSEditHistoryCompare schema to MEP
Resolved		SNowick_WMF	T263051 Migration QA for MEP iOS schema
Resolved		• jlinehan	T259710 MEP pilot instrument/schema #2 (SessionLength)
Resolved		mpopov	T238544 MEP Client MediaWiki JS (MVP)
Resolved		Ottomata	T240355 Update MW Vagrant to work with EventLogging and EventGate changes
Resolved		mforns	T244521 EventLogging MEP Upgrade Phase 1 (Submit)
Resolved		mpopov	T234594 EventLogging MEP Upgrade Phase 2 (Sampling)
Resolved		mforns	T253069 Set up an instance of EventStreams in beta that will allow for consuming any stream
Resolved		phuedx	T259708 MEP Client MediaWiki JS (non-essential features)
Declined		mpopov	T256165 EventLogging MEP Upgrade Phase 3 (Stream cc-ing)
Declined		None	T256169 Stream cc map should not be generated on every pageload
Open		Ottomata	T259712 Allow disabling/enabling configured streams via wgEventStreams config
Open		None	T267215 Changes to Session ID interface for MediaWiki event instrumentation
Open		None	T266813 mw.user.generateRandomSessionId should return a UUID
Resolved		• Mholloway	T263041 OperationError: The operation failed for an operation-specific reason in generateRandomSessionId
Open		None	T267217 MediaWiki Session ID should have per-subdomain and cross-subdomain variants
Resolved		• jlinehan	T267218 MediaWiki Session ID should persist according to user inactivity
Resolved		• jlinehan	T248987 Session Length Metric. Web implementation
Resolved		mpopov	T254897 Create session_length event schema
Resolved		• sdkim	T256311 session_tick stream configs
Resolved		• Gilles	T261701 Performance review of session length instrument (in WikimediaEvents extension)
Declined		Ottomata	T259201 Prevent schema creation in meta for eventlogging schemas
Declined		None	T260545 Provide usability tools and features for MEP Product instrumentation workflow
Declined		None	T260549 Improve rendering of event schema for browsing and documentation

Event Timeline

• jlinehan created this task.Jul 29 2020, 5:01 PM

Restricted Application added a project: Analytics. · View Herald TranscriptJul 29 2020, 5:01 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• jlinehan added a subtask: T238837: Develop test environment solution for MEP analytics events.Jul 29 2020, 5:02 PM

• jlinehan updated the task description. (Show Details)Jul 29 2020, 5:15 PM

• jlinehan added a parent task: T238230: Decommission EventLogging backend components by migrating to MEP.Jul 29 2020, 5:21 PM

• jlinehan added a subtask: T259169: BUOD-KR1-Q1: Pilot MEP clients with 2 product teams.Jul 29 2020, 5:47 PM

• jlinehan added a subtask: T259155: Obtain evidence-based guidance on capacity for event streams.Jul 29 2020, 8:08 PM

• jlinehan added a subtask: T259373: Develop strategy for mitigating degenerate client timestamps in event data.Jul 31 2020, 5:09 PM

• jlinehan added a project: Product-Data-Infrastructure.Aug 3 2020, 2:36 PM

• jlinehan moved this task from Inbox to Goals on the Product-Data-Infrastructure board.Aug 3 2020, 2:48 PM

• jlinehan renamed this task from Goal: New schema and instruments must use the MEP system to BUOD: Require that all new schema/instruments are created with the MEP system.Aug 5 2020, 12:35 PM

• jlinehan added a project: Goal.

• jlinehan updated the task description. (Show Details)

• jlinehan added a subtask: T259704: BUOD-KR1-Q2: Upgrade MEP clients to full release status.Aug 5 2020, 12:48 PM

• jlinehan removed a subtask: T259169: BUOD-KR1-Q1: Pilot MEP clients with 2 product teams.Aug 5 2020, 12:58 PM

• jlinehan claimed this task.Aug 5 2020, 1:24 PM

• jlinehan added subscribers: • dcipoletti, kzimmerman.

• jlinehan added a subscriber: • sdkim.Aug 5 2020, 2:08 PM

• jlinehan moved this task from Goals to Goal Backlog on the Product-Data-Infrastructure board.Aug 5 2020, 5:20 PM

• jlinehan moved this task from Goal Backlog to Goals on the Product-Data-Infrastructure board.

• jlinehan triaged this task as Low priority.Aug 5 2020, 5:23 PM

• jlinehan added a parent task: T259734: BUOD-KR1-Q4+: Certify that analytics schema and instruments have been upgraded to use the MEP system (clearing the legacy system for sunsetting).Aug 5 2020, 5:36 PM

mforns moved this task from Incoming to Event Platform on the Analytics board.Aug 10 2020, 3:30 PM

Ottomata added a subtask: T259201: Prevent schema creation in meta for eventlogging schemas.Aug 10 2020, 3:35 PM

• jlinehan added a subscriber: • Nuria.Aug 12 2020, 4:47 PM

• jlinehan renamed this task from BUOD: Require that all new schema/instruments are created with the MEP system to BUOD-KR1-Q3: Require that all new schema/instruments are created with the MEP system.Aug 19 2020, 5:47 PM

Ottomata moved this task from Backlog to Estimated/ Discussed on the Event-Platform board.Aug 25 2020, 4:06 PM

• jlinehan moved this task from Goals to Goal Backlog on the Product-Data-Infrastructure board.Aug 27 2020, 5:54 PM

Ottomata closed subtask T259201: Prevent schema creation in meta for eventlogging schemas as Declined.Jan 14 2021, 7:30 PM

Ottomata closed subtask T238837: Develop test environment solution for MEP analytics events as Resolved.Jan 14 2021, 7:33 PM

Ottomata closed subtask T259155: Obtain evidence-based guidance on capacity for event streams as Resolved.Jan 14 2021, 7:44 PM

• jlinehan moved this task from Inbox to Epics on the Better Use Of Data board.Feb 8 2021, 7:09 PM

Adding #Product-Infrastructure-Team-Backlog as Better Use Of Data/Product-Data-Infrastructure project tags got archived, so this open task has an active project tag and can be found.