Page MenuHomePhabricator
Create Task
Maniphest T375508

Temp accounts Grafana Dashboard: Total & Active IP Reveal users
Open, Needs TriagePublic3 Estimated Story Points
Actions

Description

  • What: Plot the number of users have enabled the permission to reveal IPs including the number of users who are auto-enrolled into viewing IPs
    • Why: Capturing this metric can help us get an estimate of how many patrollers are needing to see IP addresses to patrol effectively. We had some projections for this early on but it would be good to get actual numbers to understand this further. Would be even better to get a % of how many users qualify to opt-in versus how many choose to do so.
  • What: Plot the number of users who actively reveal IP addresses
    • Why: A step further from the above metric: Users who have opted-in to view IPs and actually use the feature frequently. This can tell us how many editors feel the need to use the feature in practice over time.

Acceptance criteria:

Details

SubjectRepoBranchLines +/-
Add metric for local users who have enabled preferencemediawiki/extensions/WikimediaEventsmaster+430 -2
Add a metric for users with global access who have accepted agreementmediawiki/extensions/WikimediaEventsmaster+310 -4
Add GlobalPreferencesConnectionProvider servicemediawiki/extensions/GlobalPreferencesmaster+287 -20
Add details about ownership of temporary account metricsmediawiki/extensions/WikimediaEventsmaster+13 -1
Schedule daily runs of WikimediaEvents UpdatePeriodicMetrics.phpoperations/puppetproduction+15 -0
Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalPreferences dependencyintegration/configmaster+2 -0
Add metric for total global temporary account IP viewersmediawiki/extensions/WikimediaEventsmaster+143 -0
Update IMetric classes to not query with empty list of valuesmediawiki/extensions/WikimediaEventsmaster+28 -5
Add metric for total global auto-enrolled temp IP viewersmediawiki/extensions/WikimediaEventsmaster+333 -85
Add GlobalGroupLookup::getGroupsWithPermissionmediawiki/extensions/CentralAuthmaster+48 -14
Zuul: [mediawiki/extensions/WikimediaEvents] Add CentralAuth dependencyintegration/configmaster+1 -0
Add metric for active temporary account IP viewersmediawiki/extensions/WikimediaEventsmaster+127 -0
[mediawiki/extensions/WikimediaEvents] Add CheckUser dependencyintegration/configmaster+2 -0
Add metric for total local temporary account IP viewersmediawiki/extensions/WikimediaEventsmaster+118 -0
Add UpdatePeriodicMetrics.phpmediawiki/extensions/WikimediaEventsmaster+170 -0
Add metric for number of auto-enrolled local temp account IP viewersmediawiki/extensions/WikimediaEventsmaster+307 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

kostajh created this task.Sep 24 2024, 12:46 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 24 2024, 12:46 PM
kostajh mentioned this in T357763: [Epic] Create a temporary accounts initiative Grafana dashboard.Sep 24 2024, 12:48 PM
Dreamy_Jazz mentioned this in T375506: Temp accounts Grafana Dashboard: Number of IP Reveal users.Sep 24 2024, 11:33 PM
kostajh moved this task from Priority Backlog to Ready on the Trust and Safety Product Sprint (Sprint Beatboxing (Sept 16-27)) board.Oct 8 2024, 10:17 AM
Niharika edited projects, added Trust and Safety Product Sprint (Sprint Cello (Oct 7 - 18)); removed Trust and Safety Product Sprint (Sprint Beatboxing (Sept 16-27)).Oct 8 2024, 10:30 AM
Niharika moved this task from Priority Backlog to Ready on the Trust and Safety Product Sprint (Sprint Cello (Oct 7 - 18)) board.
Niharika renamed this task from Temp accounts Grafana Dashboard: Active IP Reveal users to Temp accounts Grafana Dashboard: Total & Active IP Reveal users.Oct 10 2024, 6:13 AM
Niharika merged a task: T375506: Temp accounts Grafana Dashboard: Number of IP Reveal users.
Niharika updated the task description. (Show Details)
Niharika added a subscriber: Dreamy_Jazz.
Dreamy_Jazz claimed this task.Oct 23 2024, 3:17 PM
Dreamy_Jazz set the point value for this task to 2.
Dreamy_Jazz moved this task from Ready to In Progress on the Trust and Safety Product Sprint (Sprint Cello (Oct 7 - 18)) board.
gerritbot added a comment.Oct 23 2024, 4:49 PM

Change #1082513 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] Add metric for auto-enrolled local temporary account IP viewers

https://gerrit.wikimedia.org/r/1082513

gerritbot added a project: Patch-For-Review.Oct 23 2024, 4:49 PM

Change #1082514 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add UpdatePeriodicMetrics.php

https://gerrit.wikimedia.org/r/1082514

gerritbot added a comment.Oct 23 2024, 10:20 PM

Change #1082570 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add metric for total local temporary account IP viewers

https://gerrit.wikimedia.org/r/1082570

gerritbot added a comment.Oct 24 2024, 9:17 AM

Change #1082513 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for number of auto-enrolled local temp account IP viewers

https://gerrit.wikimedia.org/r/1082513

ReleaseTaggerBot added a project: MW-1.44-notes (1.44.0-wmf.1; 2024-10-29).Oct 24 2024, 10:00 AM
gerritbot added a comment.Oct 24 2024, 11:58 AM

Change #1082748 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add metric for active temporary account IP viewers

https://gerrit.wikimedia.org/r/1082748

gerritbot added a comment.Oct 24 2024, 12:06 PM

Change #1082749 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[integration/config@master] [mediawiki/extensions/WikimediaEvents] Add CheckUser dependency

https://gerrit.wikimedia.org/r/1082749

gerritbot added a comment.Oct 24 2024, 12:56 PM

Change #1082514 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add UpdatePeriodicMetrics.php

https://gerrit.wikimedia.org/r/1082514

gerritbot added a comment.Oct 24 2024, 12:56 PM

Change #1082570 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for total local temporary account IP viewers

https://gerrit.wikimedia.org/r/1082570

gerritbot added a comment.Oct 24 2024, 1:14 PM

Change #1082749 merged by jenkins-bot:

[integration/config@master] [mediawiki/extensions/WikimediaEvents] Add CheckUser dependency

https://gerrit.wikimedia.org/r/1082749

gerritbot added a comment.Oct 25 2024, 11:37 AM

Change #1082748 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for active temporary account IP viewers

https://gerrit.wikimedia.org/r/1082748

Maintenance_bot removed a project: Patch-For-Review.Oct 25 2024, 12:30 PM
gerritbot added a comment.Oct 25 2024, 1:49 PM

Change #1083175 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/CentralAuth@master] Add GlobalGroupLookup::getGroupsWithPermission

https://gerrit.wikimedia.org/r/1083175

gerritbot added a project: Patch-For-Review.Oct 25 2024, 1:49 PM
gerritbot added a comment.Oct 25 2024, 2:28 PM

Change #1083182 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add metric for total global auto-enrolled temp IP viewers

https://gerrit.wikimedia.org/r/1083182

gerritbot added a comment.Oct 25 2024, 2:36 PM

Change #1083184 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[integration/config@master] [mediawiki/extensions/WikimediaEvents] Add CentralAuth dependency

https://gerrit.wikimedia.org/r/1083184

Dreamy_Jazz changed the point value for this task from 2 to 3.Oct 25 2024, 3:06 PM
gerritbot added a comment.Oct 25 2024, 3:14 PM

Change #1083190 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] Update IMetric classes to not query with empty list of values

https://gerrit.wikimedia.org/r/1083190

gerritbot added a comment.Oct 25 2024, 3:19 PM

Change #1083184 merged by jenkins-bot:

[integration/config@master] Zuul: [mediawiki/extensions/WikimediaEvents] Add CentralAuth dependency

https://gerrit.wikimedia.org/r/1083184

gerritbot added a comment.Oct 25 2024, 3:24 PM

Change #1083175 merged by jenkins-bot:

[mediawiki/extensions/CentralAuth@master] Add GlobalGroupLookup::getGroupsWithPermission

https://gerrit.wikimedia.org/r/1083175

gerritbot added a comment.Oct 25 2024, 4:00 PM

Change #1083200 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] Add metric for total global temporary account IP viewers

https://gerrit.wikimedia.org/r/1083200

kostajh edited projects, added Trust and Safety Product Sprint (Sprint Accordion October 28 - November 15); removed Trust and Safety Product Sprint (Sprint Cello (Oct 7 - 18)).Oct 28 2024, 11:04 AM
kostajh moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Accordion October 28 - November 15) board.
gerritbot added a comment.Oct 28 2024, 12:42 PM

Change #1083182 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for total global auto-enrolled temp IP viewers

https://gerrit.wikimedia.org/r/1083182

gerritbot added a comment.Oct 28 2024, 12:43 PM

Change #1083200 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for total global temporary account IP viewers

https://gerrit.wikimedia.org/r/1083200

gerritbot added a comment.Oct 28 2024, 12:43 PM

Change #1083190 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Update IMetric classes to not query with empty list of values

https://gerrit.wikimedia.org/r/1083190

Maintenance_bot removed a project: Patch-For-Review.Oct 28 2024, 1:30 PM
gerritbot added a comment.Oct 28 2024, 3:15 PM

Change #1083838 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add another metric

https://gerrit.wikimedia.org/r/1083838

gerritbot added a project: Patch-For-Review.Oct 28 2024, 3:15 PM
gerritbot added a comment.Oct 28 2024, 3:34 PM

Change #1083845 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[integration/config@master] Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalPreferences dependency

https://gerrit.wikimedia.org/r/1083845

kostajh moved this task from Backlog to In progress on the Temporary accounts (Blockers to minor pilot wiki deployment) board.Oct 28 2024, 4:38 PM
gerritbot added a comment.Oct 28 2024, 11:39 PM

Change #1083933 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/GlobalPreferences@master] Add GlobalPreferencesConnectionProvider service

https://gerrit.wikimedia.org/r/1083933

gerritbot added a comment.Oct 29 2024, 5:42 PM

Change #1083845 merged by jenkins-bot:

[integration/config@master] Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalPreferences dependency

https://gerrit.wikimedia.org/r/1083845

Stashbot added a comment.Oct 29 2024, 5:42 PM

Mentioned in SAL (#wikimedia-releng) [2024-10-29T17:42:40Z] <James_F> Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalPreferences dependency, for T375508

gerritbot added a comment.Oct 30 2024, 11:23 AM

Change #1084739 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Add metric for local users who have enabled preference

https://gerrit.wikimedia.org/r/1084739

gerritbot added a comment.Nov 1 2024, 5:14 PM

Change #1085620 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[operations/puppet@production] Schedule daily runs of WikimediaEvents UpdatePeriodicMetrics.php

https://gerrit.wikimedia.org/r/1085620

Dreamy_Jazz moved this task from In Progress to Needs review on the Trust and Safety Product Sprint (Sprint Accordion October 28 - November 15) board.Nov 4 2024, 5:03 PM
gerritbot added a comment.Nov 5 2024, 11:59 AM

Change #1087436 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] Add details about ownership of temporary account metrics

https://gerrit.wikimedia.org/r/1087436

gerritbot added a comment.Nov 7 2024, 5:01 PM

Change #1085620 merged by RLazarus:

[operations/puppet@production] Schedule daily runs of WikimediaEvents UpdatePeriodicMetrics.php

https://gerrit.wikimedia.org/r/1085620

Stashbot added a comment.Nov 7 2024, 5:06 PM

Mentioned in SAL (#wikimedia-operations) [2024-11-07T17:06:19Z] <rzl> manually run mediawiki_job_wikimediaevents-UpdatePeriodicMetrics-per-wiki # T375508

Stashbot added a comment.Nov 7 2024, 5:12 PM

Mentioned in SAL (#wikimedia-operations) [2024-11-07T17:12:09Z] <rzl> manually run mediawiki_job_wikimediaevents-UpdatePeriodicMetrics-global # T375508

gerritbot added a comment.Nov 15 2024, 10:10 AM

Change #1087436 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add details about ownership of temporary account metrics

https://gerrit.wikimedia.org/r/1087436

ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.4; 2024-11-19); removed MW-1.44-notes (1.44.0-wmf.1; 2024-10-29).Nov 15 2024, 11:00 AM
Tchanders edited projects, added Trust and Safety Product Sprint (Sprint Gong (November 18 - December 6)); removed Trust and Safety Product Sprint (Sprint Accordion October 28 - November 15).Nov 18 2024, 11:43 AM
Tchanders moved this task from Priority Backlog to Needs review on the Trust and Safety Product Sprint (Sprint Gong (November 18 - December 6)) board.
gerritbot added a comment.Nov 26 2024, 7:37 AM

Change #1083933 merged by jenkins-bot:

[mediawiki/extensions/GlobalPreferences@master] Add GlobalPreferencesConnectionProvider service

https://gerrit.wikimedia.org/r/1083933

ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.6; 2024-12-03); removed MW-1.44-notes (1.44.0-wmf.4; 2024-11-19).Nov 26 2024, 8:00 AM
kostajh updated the task description. (Show Details)Tue, Dec 3, 1:52 PM
kostajh changed the task status from Open to Stalled.Tue, Dec 3, 2:01 PM

Blocked on T380609: Maintenance scripts do not emit StatsLib metrics

gerritbot added a comment.Tue, Dec 3, 3:18 PM

Change #1083838 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add a metric for users with global access who have accepted agreement

https://gerrit.wikimedia.org/r/1083838

gerritbot added a comment.Tue, Dec 3, 3:18 PM

Change #1084739 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add metric for local users who have enabled preference

https://gerrit.wikimedia.org/r/1084739

Maintenance_bot removed a project: Patch-For-Review.Tue, Dec 3, 3:30 PM
ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.8; 2024-12-17); removed MW-1.44-notes (1.44.0-wmf.6; 2024-12-03).Tue, Dec 3, 4:00 PM
Dreamy_Jazz moved this task from Needs review to Ready on the Trust and Safety Product Sprint (Sprint Gong (November 18 - December 6)) board.Wed, Dec 4, 1:27 PM
kostajh moved this task from Ready to Priority Backlog on the Trust and Safety Product Sprint (Sprint Gong (November 18 - December 6)) board.Thu, Dec 5, 11:19 AM
Dreamy_Jazz moved this task from Sprint Gong (November 18 - December 6) to Sprint Chimes (Dec. 9 - Jan. 17) on the Trust and Safety Product Sprint board.Mon, Dec 9, 4:58 PM
Dreamy_Jazz edited projects, added Trust and Safety Product Sprint (Sprint Chimes (Dec. 9 - Jan. 17)); removed Trust and Safety Product Sprint (Sprint Gong (November 18 - December 6)).
Dreamy_Jazz changed the task status from Stalled to Open.Fri, Dec 13, 12:03 PM

Subtask is resolved and data now appears in Grafana. We should be able to move forward with this task.

Dreamy_Jazz moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Chimes (Dec. 9 - Jan. 17)) board.Fri, Dec 13, 12:03 PM
Dreamy_Jazz added a comment.Fri, Dec 13, 12:26 PM

Some of the dashboards have been added. However, some metrics are not appearing in the list of metrics to select. I'll check again to see if this metric appears next week.

kostajh added a comment.Fri, Dec 13, 2:18 PM
In T375508#10402876, @Dreamy_Jazz wrote:

Some of the dashboards have been added. However, some metrics are not appearing in the list of metrics to select. I'll check again to see if this metric appears next week.

Hmm, via curl -s https://grafana.wikimedia.org/api/datasources/uid/000000026/resources/api/v1/label/__name__/values\? | jq | grep WikimediaEvents I can see:

"mediawiki_WikimediaEvents_global_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_globally_auto_enrolled_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_local_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_locally_auto_enrolled_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_active_temporary_account_ip_viewers_total"
Dreamy_Jazz added a comment.Fri, Dec 13, 2:33 PM
In T375508#10403097, @kostajh wrote:
In T375508#10402876, @Dreamy_Jazz wrote:

Some of the dashboards have been added. However, some metrics are not appearing in the list of metrics to select. I'll check again to see if this metric appears next week.

Hmm, via curl -s https://grafana.wikimedia.org/api/datasources/uid/000000026/resources/api/v1/label/__name__/values\? | jq | grep WikimediaEvents I can see:

"mediawiki_WikimediaEvents_global_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_globally_auto_enrolled_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_local_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_locally_auto_enrolled_temporary_account_ip_viewers_total",
"mediawiki_WikimediaEvents_active_temporary_account_ip_viewers_total"

We are specifically missing mediawiki_WikimediaEvents_global_temporary_account_ip_viewers_with_enabled_preference_total and mediawiki_WikimediaEvents_local_temporary_account_ip_viewers_with_enabled_preference_total. On a second look it appears that these metrics don't appear because there was no train this week and the metrics were not merged in time last week's train.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits