Add instrumentation to Special:EditGrowthConfig
Closed, ResolvedPublic
Actions

Description

The Growth team created community configuration that empowers communities to customize certain aspects of Growth features. It looks that only a couple of communities actually use that option though. It'd be useful to know how the special page is used. To be able to learn more and monitor how community configuration is used, let's instrument it. We want to instrument page loads and saves of configuration.

Logged events should have at least the following fields:

action: enum, set to either view or save, depending on the action user preformed
privileged_user: boolean that's true if the user is able to use the form
performer: who caused the event (only populated for saves, to protect user privacy)

Acceptance criteria

Special:EditGrowthConfig logs events in EventLogging as described in the task

Details

Subject	Repo	Branch	Lines +/-
SpecialEditGrowthConfigLogger: Add is_registered_user	mediawiki/extensions/GrowthExperiments	master	+3 -1
analytics/mediawiki/editgrowthconfig: Add is_registered_user	schemas/event/secondary	master	+347 -4
SpecialEditGrowthConfigLogger: Update schema version	mediawiki/extensions/GrowthExperiments	wmf/1.39.0-wmf.23	+1 -1
SpecialEditGrowthConfigLogger: Update schema version	mediawiki/extensions/GrowthExperiments	master	+1 -1
analytics/mediawiki/editgrowthconfig: Ref analytics/common	schemas/event/secondary	master	+338 -4
Declare mediawiki.editgrowthconfig schema	operations/mediawiki-config	master	+5 -0
Add basic instrumentation to SpecialEditGrowthConfig	mediawiki/extensions/GrowthExperiments	master	+108 -1
Add analytics/mediawiki/editgrowthconfig	schemas/event/secondary	master	+293 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Urbanecm_WMF	T312148 Add instrumentation to Special:EditGrowthConfig
		Resolved	PRODUCTION ERROR	Urbanecm_WMF	T314173 editgrowthconfig schema: '' should NOT have additional properties,

Event Timeline

Urbanecm_WMF created this task.Jul 5 2022, 6:10 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 5 2022, 6:10 PM

Change 811357 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[schemas/event/secondary@master] Add analytics/mediawiki/editgrowthconfig

https://gerrit.wikimedia.org/r/811357

Change 811358 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@master] Add basic instrumentation to SpecialEditGrowthConfig

https://gerrit.wikimedia.org/r/811358

Urbanecm_WMF triaged this task as Medium priority.Jul 5 2022, 8:14 PM

Urbanecm_WMF moved this task from Incoming to Code Review on the Growth-Team (Sprint 0 (Growth Team)) board.

Urbanecm_WMF moved this task from Backlog to In review on the User-Urbanecm_WMF (Engineering) board.

Change 811357 merged by jenkins-bot:

[schemas/event/secondary@master] Add analytics/mediawiki/editgrowthconfig

https://gerrit.wikimedia.org/r/811357

Change 811358 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] Add basic instrumentation to SpecialEditGrowthConfig

https://gerrit.wikimedia.org/r/811358

Maintenance_bot removed a project: Patch-For-Review.Jul 6 2022, 9:30 PM

Change 811910 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[operations/mediawiki-config@master] Declare mediawiki.editgrowthconfig schema

https://gerrit.wikimedia.org/r/811910

gerritbot added a project: Patch-For-Review.Jul 7 2022, 8:53 AM

Change 811910 merged by jenkins-bot:

[operations/mediawiki-config@master] Declare mediawiki.editgrowthconfig schema

https://gerrit.wikimedia.org/r/811910

Mentioned in SAL (#wikimedia-operations) [2022-07-07T09:43:46Z] <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 8599f395bd3af2b27aa06cdc318d44e97efc8119: Declare mediawiki.editgrowthconfig schema (T312148) (duration: 03m 37s)

Maintenance_bot removed a project: Patch-For-Review.Jul 7 2022, 10:30 AM

I can't get any data in https://stream-beta.wmflabs.org/v2/ui/#/ when using the special:editgrowthconfig page. i'll investigate.

ReleaseTaggerBot added a project: MW-1.39-notes (1.39.0-wmf.21; 2022-07-18).Jul 12 2022, 4:01 AM

Urbanecm_WMF moved this task from In review to Backlog on the User-Urbanecm_WMF (Engineering) board.Aug 2 2022, 12:33 PM

Urbanecm_WMF mentioned this in T314173: editgrowthconfig schema: '' should NOT have additional properties,.Aug 3 2022, 8:27 PM

Urbanecm_WMF added a subtask: T314173: editgrowthconfig schema: '' should NOT have additional properties,.

Change 820227 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[schemas/event/secondary@master] analytics/mediawiki/editgrowthconfig: Ref analytics/common

https://gerrit.wikimedia.org/r/820227

Change 820228 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@master] SpecialEditGrowthConfigLogger: Update schema version

https://gerrit.wikimedia.org/r/820228

Urbanecm_WMF moved this task from In Progress to Code Review on the Growth-Team (Sprint 0 (Growth Team)) board.Aug 3 2022, 8:55 PM

Change 820227 merged by jenkins-bot:

[schemas/event/secondary@master] analytics/mediawiki/editgrowthconfig: Ref analytics/common

https://gerrit.wikimedia.org/r/820227

Change 820228 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] SpecialEditGrowthConfigLogger: Update schema version

https://gerrit.wikimedia.org/r/820228

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.25; 2022-08-15); removed MW-1.39-notes (1.39.0-wmf.21; 2022-07-18).Aug 4 2022, 8:00 AM

Change 820276 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@wmf/1.39.0-wmf.23] SpecialEditGrowthConfigLogger: Update schema version

https://gerrit.wikimedia.org/r/820276

In T312148#8061973, @Urbanecm_WMF wrote:

I can't get any data in https://stream-beta.wmflabs.org/v2/ui/#/ when using the special:editgrowthconfig page. i'll investigate.

After T314173: editgrowthconfig schema: '' should NOT have additional properties, got fixed, it works! I'll push it to wmf.23 too and verify at testwiki.

Change 820276 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.39.0-wmf.23] SpecialEditGrowthConfigLogger: Update schema version

https://gerrit.wikimedia.org/r/820276

In T312148#8130512, @Urbanecm_WMF wrote:

In T312148#8061973, @Urbanecm_WMF wrote:

I can't get any data in https://stream-beta.wmflabs.org/v2/ui/#/ when using the special:editgrowthconfig page. i'll investigate.

After T314173: editgrowthconfig schema: '' should NOT have additional properties, got fixed, it works! I'll push it to wmf.23 too and verify at testwiki.

Seems to work!

Mentioned in SAL (#wikimedia-operations) [2022-08-04T09:38:50Z] <urbanecm@deploy1002> Synchronized php-1.39.0-wmf.23/extensions/GrowthExperiments/includes/EventLogging/SpecialEditGrowthConfigLogger.php: ba67dd940217e9f786f4349b4da0fe088475fde9: SpecialEditGrowthConfigLogger: Update schema version (T314173, T312148) (duration: 03m 18s)

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.23; 2022-08-01); removed MW-1.39-notes (1.39.0-wmf.25; 2022-08-15).Aug 4 2022, 10:00 AM

I checked the data, and I forgot to account for spiders that go to Special:EditGrowthConfig as well. While we can do something like this:

ADD JAR hdfs://analytics-hadoop/wmf/refinery/current/artifacts/org/wikimedia/analytics/refinery/refinery-hive-0.1.2.jar;
CREATE TEMPORARY FUNCTION is_spider as 'org.wikimedia.analytics.refinery.hive.IsSpiderUDF';
SELECT * FROM event.mediawiki_editgrowthconfig WHERE year=2022 AND is_spider(http.request_headers['user-agent']) = false LIMIT 10;

it's still possible many spiders will fall through (as they do in pageviews), and the data will be inaccurate. Let's add is_registered_user to the schema as well, that should make the data more reliable (and we're also more interested in community-initiated views anyway).

Change 820661 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[schemas/event/secondary@master] analytics/mediawiki/editgrowthconfig: Add is_registered_user

https://gerrit.wikimedia.org/r/820661

Change 820662 had a related patch set uploaded (by Urbanecm; author: Urbanecm):

[mediawiki/extensions/GrowthExperiments@master] SpecialEditGrowthConfigLogger: Add is_registered_user

https://gerrit.wikimedia.org/r/820662

Urbanecm_WMF moved this task from In Progress to Code Review on the Growth-Team (Sprint 0 (Growth Team)) board.Aug 5 2022, 9:43 AM

Etonkovidova closed subtask T314173: editgrowthconfig schema: '' should NOT have additional properties, as Resolved.Aug 9 2022, 1:49 AM

Urbanecm_WMF removed a project: User-Urbanecm_WMF (Engineering).Aug 11 2022, 10:38 AM

Urbanecm_WMF changed the task status from Open to In Progress.Aug 11 2022, 11:08 AM

Change 820661 merged by jenkins-bot:

[schemas/event/secondary@master] analytics/mediawiki/editgrowthconfig: Add is_registered_user

https://gerrit.wikimedia.org/r/820661

Tgr moved this task from Code Review to QA on the Growth-Team (Sprint 0 (Growth Team)) board.Aug 15 2022, 10:39 PM

Urbanecm_WMF changed the task status from In Progress to Open.Aug 16 2022, 6:05 AM

Change 820662 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] SpecialEditGrowthConfigLogger: Add is_registered_user

https://gerrit.wikimedia.org/r/820662

ReleaseTaggerBot edited projects, added MW-1.39-notes (1.39.0-wmf.25; 2022-08-15); removed MW-1.39-notes (1.39.0-wmf.23; 2022-08-01).Aug 16 2022, 7:00 AM

Etonkovidova moved this task from QA to Test in Production | Watching on the Growth-Team (Sprint 0 (Growth Team)) board.Aug 16 2022, 8:57 PM

Tested in enwiki betalabs (https://stream-beta.wmflabs.org/v2/ui/#/?streams=mediawiki.editgrowthconfig)
All seems to be in place, e.g. (abbreviated):

{"meta":{"domain":"en.wikipedia.beta.wmflabs.org","stream":"mediawiki.editgrowthconfig","$schema":"/analytics/mediawiki/editgrowthconfig/1.0.2","database":"enwiki","action":"save","is_privileged_user":true,"is_registered_user":true,"performer":{"user_id":6768,"user_text":"ET13"},"dt":"2022-08-24T01:20:15Z"}

Add instrumentation to Special:EditGrowthConfigClosed, ResolvedPublicActions