Update purging settings for Schema:Popups
Closed, ResolvedPublic3 Estimated Story Points
Actions

Assigned To

Authored By

	• Tbayer
	Jun 8 2017, 5:13 PM

Description

(This schema has seen several updates in 2016 and 2017 since it was first entered into the whitelist.)
As per the talk page documentation: Auto-purge just eventCapsule PII after 90 days, keep the rest indefinitely. This means that an update is needed for the following fields:
event_namespaceIdSource
event_pageIdSource (this is basically redundant to the already whitelisted event_pageTitleSource, but makes some queries easier)
event_namespaceIdHover
event_isAnon
event_totalInteractionTime
event_hovercardsSuppressedByGadget
event_perceivedWait
event_editCountBucket
event_previewCountBucket
event_linkInteractionToken (unique to this schema)
event_pageToken (unique to this schema)
event_previewType
event_version

Also, "event_sessionId" in the current whitelist looks like a typo (AFAICS there was never a field with that name in this schema) and should read "event_sessionToken" instead

Related Objects

Mentioned Here: T156933: Improve purging for analytics-slave data on Eventlogging

Event Timeline

• Tbayer created this task.Jun 8 2017, 5:13 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 8 2017, 5:13 PM

@Tbayer or @mforns are you planning to do this or do you need web team assistance (ie. do we need to plan it for an upcoming sprint?)

Jdlrobson moved this task from Incoming to Needs Prioritization on the Web-Team-Backlog board.Jun 8 2017, 8:37 PM

@Jdlrobson As you can see, it's assigned to a member of the Analytics team. I expect that no work from the web team will be required, so feel fre to remove it from the project.

Jdlrobson moved this task from Needs Prioritization to 2014-15 Q4 on the Web-Team-Backlog board.Jun 8 2017, 9:28 PM

• Nuria added a project: Analytics-Kanban.Jun 12 2017, 3:38 PM

• Nuria removed a project: Analytics.

mforns moved this task from Next Up to In Progress on the Analytics-Kanban board.Jun 13 2017, 2:32 PM

In the following update to the white-list
https://gerrit.wikimedia.org/r/#/c/298721/9..10/files/mariadb/eventlogging_purging_whitelist.tsv
I applied the following changes:

### Fields that were already on the list (no action)
event_action
wiki
webHost
isTruncated
clientValidated
event_duration
event_pageTitleHover
event_pageTitleSource
event_popupDelay
event_popupEnabled

### Added the following fields
event_sessionToken
event_version
event_pageIdSource
event_namespaceIdSource
event_namespaceIdHover
event_isAnon
event_totalInteractionTime
event_previewType
event_hovercardsSuppressedByGadget
event_perceivedWait
event_editCountBucket
event_previewCountBucket
event_linkInteractionToken
event_pageToken

### Removed the following fields
event_sessionId

Please, review! We'll merge this change in short and hopefully execute the purging script before the end of the quarter.
BTW, thank you guys for trying to make non-sensitive schemas by using bucketized fields!

mforns moved this task from In Progress to In Code Review on the Analytics-Kanban board.Jun 13 2017, 3:32 PM

mforns moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Jun 14 2017, 3:54 PM

mforns set the point value for this task to 3.Jun 16 2017, 3:12 PM

Looks good, thanks!

ovasileva moved this task from Backlog to In Development on the Page-Previews board.Jun 20 2017, 1:04 PM

Milimetric triaged this task as Medium priority.Jun 22 2017, 3:07 PM

Jdlrobson moved this task from 2014-15 Q4 to Tracking on the Web-Team-Backlog board.Jun 29 2017, 8:20 PM

Jdlrobson edited projects, added Web-Team-Backlog (Tracking); removed Web-Team-Backlog.

Jdlrobson removed a project: Web-Team-Backlog (Tracking).

Jdlrobson added a project: Web-Team-Backlog (Tracking).Jun 29 2017, 8:57 PM

Jdlrobson moved this task from Untriaged to Move to Backlog on the Web-Team-Backlog (Tracking) board.Jun 29 2017, 9:04 PM

Will move this task to done, because the editing of the white-list is finished and will be merged in a Gerrit patch belonging to another task: T156933.

mforns moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Jul 10 2017, 3:34 PM

• Nuria closed this task as Resolved.Jul 11 2017, 6:39 PM

Update purging settings for Schema:PopupsClosed, ResolvedPublic3 Estimated Story PointsActions

Description

Related Objects

Event Timeline

Update purging settings for Schema:Popups
Closed, ResolvedPublic3 Estimated Story Points
Actions