Community updates module: Update Superset dashboard to support pilot wiki experiment
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	KStoller-WMF
	Oct 10 2024, 8:52 PM

Description

User story:

As Growth PM, I want to be able to see Superset metrics for any Wiki that has the Community Updates module enabled, because then I can make make an informed decision and share details with communities*.

*results to be shared after experiment concludes here: https://www.mediawiki.org/wiki/Growth/Community_Updates

Details:

We created this Superset dashboard for monitoring TestWiki instrumentation.

Let's make updates so this dashboard will work for our pilot wiki experiment.

Update logic as needed
Retitle to just "Community Updates" to address the long title issue: https://phabricator.wikimedia.org/T371347#10200715

Acceptance Criteria:

Events sent from Community Updates module on Wikipedia are collected by Metrics Platform are visible on Superset

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Growth [test2wiki]: enable community updates module	operations/mediawiki-config	master	+1 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	KStoller-WMF	T360485 [EPIC] Newcomer homepage: Community updates module (FY23/24 WE1.3 / FY24/25 SDS2.1.3)
Resolved	KStoller-WMF	T365889 [EPIC] Community updates module: instrumentation & measurement (SDS 2.1.3)
Resolved	Cyndymediawiksim	T376952 Community updates module: Update Superset dashboard to support pilot wiki experiment

Event Timeline

KStoller-WMF created this task.Oct 10 2024, 8:52 PM

KStoller-WMF triaged this task as Medium priority.

KStoller-WMF moved this task from Inbox to Up Next (estimated tasks) on the Growth-Team board.

KStoller-WMF mentioned this in T371347: Metrics Platform Integration: Verify that we can query for the data points that were captured by Metrics Platform on Superset or Turnilo.

Cyndymediawiksim subscribed.Oct 11 2024, 12:10 PM

KStoller-WMF set the point value for this task to 1.Oct 15 2024, 4:28 PM

KStoller-WMF moved this task from Up Next (estimated tasks) to Current Sprint on the Growth-Team board.Oct 15 2024, 4:51 PM

KStoller-WMF edited projects, added Growth-Team (Current Sprint); removed Growth-Team.

Cyndymediawiksim claimed this task.Oct 16 2024, 7:30 AM

Cyndymediawiksim moved this task from Incoming to Doing on the Growth-Team (Current Sprint) board.Oct 23 2024, 1:43 PM

Cyndymediawiksim moved this task from Doing to Blocked / Needs Work on the Growth-Team (Current Sprint) board.Oct 24 2024, 10:37 AM

Change #1084036 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[operations/mediawiki-config@master] Growth [test2wiki]: enable community updates module

https://gerrit.wikimedia.org/r/1084036

gerritbot added a project: Patch-For-Review.Oct 29 2024, 9:15 AM

Cyndymediawiksim moved this task from Blocked / Needs Work to Doing on the Growth-Team (Current Sprint) board.Oct 30 2024, 7:26 AM

Change #1084036 merged by jenkins-bot:

[operations/mediawiki-config@master] Growth [test2wiki]: enable community updates module

https://gerrit.wikimedia.org/r/1084036

Mentioned in SAL (#wikimedia-operations) [2024-10-30T13:19:29Z] <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1084036|Growth [test2wiki]: enable community updates module (T376952)]], [[gerrit:1081099|[Growth] beta: configure the A/B test experiment variants (T377233)]]

Stashbot mentioned this in T377233: Show Community updates module based on experiment variant.Oct 30 2024, 1:19 PM

Maintenance_bot removed a project: Patch-For-Review.Oct 30 2024, 1:31 PM

We have enabled CommunityUpdates in test2wiki, I tested events are sent but not sure if they are ingested. @Cyndymediawiksim could you check if the events are properly ingested and we can see the data in the existing dashboard? Ty!

Mentioned in SAL (#wikimedia-operations) [2024-10-30T13:48:29Z] <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1084036|Growth [test2wiki]: enable community updates module (T376952)]], [[gerrit:1081099|[Growth] beta: configure the A/B test experiment variants (T377233)]] (duration: 29m 00s)

Sgs moved this task from Doing to Test in Production on the Growth-Team (Current Sprint) board.Oct 31 2024, 10:43 AM

In T376952#10276864, @Sgs wrote:

We have enabled CommunityUpdates in test2wiki, I tested events are sent but not sure if they are ingested. @Cyndymediawiksim could you check if the events are properly ingested and we can see the data in the existing dashboard? Ty!

Checked events for test2wiki last week events - there are some events registered for Oct 30. The clicks made on Oct 31 are not shown yet - I'll post update when the events will be reflected on the dashboard.
The events for pilots wikis are shown, e.g. eswiki last week (Oct30-31 events)

Yay, it's exciting to see initial data start to come in!
And the CTR looks to be in a healthy range.

Retitle to just "Community Updates"

@Cyndymediawiksim - is this still happening?

@KStoller-WMF , yes, dashboard renamed : https://superset.wikimedia.org/superset/dashboard/552/?native_filters_key=AUB2ivDvicidAvj-J9KKBoUCzk1TFk1iiQD7jxLbTKk37pVSr435BzTs0UFWpRRm

In T376952#10285392, @Cyndymediawiksim wrote:

@KStoller-WMF , yes, dashboard renamed : https://superset.wikimedia.org/superset/dashboard/552/?native_filters_key=AUB2ivDvicidAvj-J9KKBoUCzk1TFk1iiQD7jxLbTKk37pVSr435BzTs0UFWpRRm

A super minor note - each chart on the dashboard has testwiki as a part of the title - e.g. " ("SDS 2 Sprinthackular 2024 - Community Updates - CTR (testwiki)". Is there a reason to have testwiki in the title?

@Etonkovidova, We do not need to have testwiki in the title. Unfortunately I do not have the permissions to rename the charts(i think that right is reserved for the creator of the chart). Pinging @mforns for visibility and help us in renaming. :)

Screenshot 2024-11-01 at 23.05.49.png (1×3 px, 551 KB)

In T376952#10285454, @Cyndymediawiksim wrote:

@Etonkovidova, We do not need to have testwiki in the title. Unfortunately I do not have the permissions to rename the charts(i think that right is reserved for the creator of the chart). Pinging @mforns for visibility and help us in renaming. :)

Thank you, @Cyndymediawiksim!

Checked for events triggered on test2wiki - the events get displayed after >12h, the data on the graphs for the last 24 hours might not reflect the actual stats.

@KStoller-WMF - I checked events for the pilot wikis - this link. Could you take a look to make sure that no follow-ups are needed for this task?

It looks good to me, and I've been looking at the data at least once a week. Thanks for the work on this Cyndy and Marcel!

	F57667763: Screenshot 2024-11-01 at 23.05.49.png
	Nov 1 2024, 8:11 PM

Community updates module: Update Superset dashboard to support pilot wiki experimentClosed, ResolvedPublic1 Estimated Story PointsActions