Description

This task tracks both finding out whether the EditorActivation instrument should be decommissioned and the steps to decommission it.

Should the EditorActivation instrument be decommissioned

In T284679: EditorActivation Event Platform Migration, the Legacy EventLogging schema was declined to be migrated to the Event Platform. As noted in the task, active editors is a "pretty useful metric" to have but the metric is also publicly available from other sources, i.e. https://stats.wikimedia.org/#/en.wikipedia.org/contributing/active-editors/normal|line|2-year|(page_type)~content|monthly and https://stats.wikimedia.org/#/en.wikipedia.org/contributing/active-editors-by-country/normal|map|last-month|(activity-level)~5..99-edits|monthly.

According to https://meta.wikimedia.org/wiki/Schema_talk:EditorActivation, this instrument does not have an associated project.

TODO

Remove the instrumentation code
- https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/896317
Stop refining events
Mark the schema as inactive on metawiki
- https://meta.wikimedia.org/w/index.php?title=Schema_talk%3AEditorActivation&diff=24784130&oldid=15763172
Remove the event santization allowlist entry
- https://gerrit.wikimedia.org/r/c/analytics/refinery/+/896326
Mark the event.editoractivation table as deprecated in DataHub
MAYBE mark the event_sanitized.editoractivation table as deprecated in DataHub

	Subject	Repo	Branch	Lines +/-
	Remove EditorActivation allowlist entry	analytics/refinery	master	+0 -7
	Decommission the EditorActivation instrument	mediawiki/extensions/WikimediaEvents	master	+0 -66

Status	Assigned	Task
Resolved	Ottomata	T185233 Modern Event Platform
Resolved	Ottomata	T238230 Decommission EventLogging backend components by migrating to MEP
Declined	None	T259734 BUOD-KR1-Q4+: Certify that analytics schema and instruments have been upgraded to use the MEP system (clearing the legacy system for sunsetting)
Resolved	Ottomata	T259163 Migrate legacy metawiki schemas to Event Platform
Resolved	Ottomata	T282131 Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned
Resolved	phuedx	T330766 Decommission the EditorActivation instrument

Event Timeline

phuedx created this task.Feb 28 2023, 3:15 PM

Restricted Application added a project: Data-Engineering. · View Herald TranscriptFeb 28 2023, 3:15 PM

mpopov moved this task from Triage to Tracking on the Product-Analytics board.Feb 28 2023, 6:09 PM

This task came up in the Product Analytics team's board refinement meeting, and I wanted to chime in and confirm that the Growth team doesn't use this instrumentation in our analyses. Or in other words, from the perspective of the Growth team this instrumentation is safe to decommission.

phuedx updated the task description. (Show Details)Mar 1 2023, 7:35 AM

Thanks, @nettrom_WMF!

@Mayakp.wiki also pointed out that the wmf_product.active_editors table, which is used to generate reports on active editors, is generated from the wmf.mediawiki_history table (see https://github.com/wikimedia/analytics-wmf-product-jobs/blob/master/movement_metrics/notebooks/supplementary/queries/update_active_editors.hql and https://github.com/wikimedia/analytics-wmf-product-jobs/blob/master/movement_metrics/notebooks/supplementary/queries/update_editor_month.hql).

• lbowmaker moved this task from Incoming (new tickets) to Tag with Radar on the Data-Engineering board.Mar 1 2023, 5:19 PM

phuedx updated the task description. (Show Details)Mar 3 2023, 2:47 PM

@ori: You're listed as the maintainer for the EditorActivation schema. Do you know if anything/anyone is using the data logged by the instrument?

@phuedx I don't know, sorry.

In T330766#8655569, @phuedx wrote:

@Mayakp.wiki also pointed out that the wmf_product.active_editors table, which is used to generate reports on active editors, is generated from the wmf.mediawiki_history table (see https://github.com/wikimedia/analytics-wmf-product-jobs/blob/master/movement_metrics/notebooks/supplementary/queries/update_active_editors.hql and https://github.com/wikimedia/analytics-wmf-product-jobs/blob/master/movement_metrics/notebooks/supplementary/queries/update_editor_month.hql).

Further to this, there are no mentions of EditorActivation outside of the instrument's implementation and the sanitisation allowlist:

Given all of the above (and, most importantly, that there is an equivalent dataset in the wmf.mediawiki_history table), I think we can proceed with decommissioning the EditorActivation instrument.

Change 896317 had a related patch set uploaded (by Phuedx; author: Phuedx):

[mediawiki/extensions/WikimediaEvents@master] Decommission the EditorActivation instrument

https://gerrit.wikimedia.org/r/896317

gerritbot added a project: Patch-For-Review.Mar 10 2023, 10:51 AM

Change 896326 had a related patch set uploaded (by Phuedx; author: Phuedx):

[analytics/refinery@master] Remove EditorActivation allowlist entry

https://gerrit.wikimedia.org/r/896326

Change 896317 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Decommission the EditorActivation instrument

https://gerrit.wikimedia.org/r/896317

ReleaseTaggerBot added a project: MW-1.41-notes (1.41.0-wmf.2; 2023-03-27).Mar 24 2023, 8:00 PM

phuedx updated the task description. (Show Details)Mar 27 2023, 8:43 AM