Page MenuHomePhabricator
Create Task
Maniphest T402767

hCaptcha: Log hCaptcha error codes to Logstash and Prometheus
Closed, ResolvedPublic
Actions

Description

Summary

hCaptcha can return a number of error codes to the client (load error, rate limited, challenge expired, etc) -- we should log these to Logstash so that we have visibility into the frequency of these occurring. We should also emit events to Prometheus for tracking in Grafana.

Technical notes

  • Use mw.errorLogger.logError() to export these messages to Logstash
  • Use mw.track( 'stats. [...] ) for exporting to Prometheus

Acceptance criteria

  • hCaptcha errors appear in mw-client-errors
  • Errors and form submission events can be plotted in Grafana

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects

Event Timeline

kostajh created this task.Aug 25 2025, 8:43 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 25 2025, 8:43 AM
gerritbot added a comment.Aug 25 2025, 8:44 AM

Change #1181643 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log errors to Logstash

https://gerrit.wikimedia.org/r/1181643

gerritbot added a project: Patch-For-Review.Aug 25 2025, 8:44 AM
gerritbot added a comment.Aug 25 2025, 10:36 AM

Change #1181665 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.15] hCaptcha: Log errors to Logstash

https://gerrit.wikimedia.org/r/1181665

gerritbot added a comment.Aug 25 2025, 10:50 AM

Change #1181665 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.15] hCaptcha: Log errors to Logstash

https://gerrit.wikimedia.org/r/1181665

Stashbot added a comment.Aug 25 2025, 10:50 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-25T10:50:21Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1181664|hcaptcha: Instrument siteverify API call (T402492)]], [[gerrit:1181665|hCaptcha: Log errors to Logstash (T402767)]]

Stashbot mentioned this in T402492: hCaptcha: Instrument call to /siteverify.Aug 25 2025, 10:50 AM
Stashbot added a comment.Aug 25 2025, 10:56 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-25T10:56:32Z] <kharlan@deploy1003> kharlan: Backport for [[gerrit:1181664|hcaptcha: Instrument siteverify API call (T402492)]], [[gerrit:1181665|hCaptcha: Log errors to Logstash (T402767)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

gerritbot added a comment.Aug 25 2025, 10:59 AM

Change #1181643 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log errors to Logstash

https://gerrit.wikimedia.org/r/1181643

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.16; 2025-08-26).Aug 25 2025, 11:00 AM
Stashbot added a comment.Aug 25 2025, 11:04 AM

Mentioned in SAL (#wikimedia-operations) [2025-08-25T11:04:48Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1181664|hcaptcha: Instrument siteverify API call (T402492)]], [[gerrit:1181665|hCaptcha: Log errors to Logstash (T402767)]] (duration: 14m 26s)

Maintenance_bot removed a project: Patch-For-Review.Aug 25 2025, 11:30 AM
kostajh closed this task as Resolved.Aug 26 2025, 1:29 PM
kostajh claimed this task.
gerritbot added a comment.Sep 17 2025, 7:17 AM

Change #1189040 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Track errors via Prometheus

https://gerrit.wikimedia.org/r/1189040

gerritbot added a project: Patch-For-Review.Sep 17 2025, 7:17 AM
kostajh renamed this task from hCaptcha: Log hCaptcha error codes to Logstash to hCaptcha: Log hCaptcha error codes to Logstash and Prometheus.Sep 17 2025, 7:17 AM
kostajh reopened this task as Open.
kostajh updated the task description. (Show Details)Sep 17 2025, 7:52 AM
gerritbot added a comment.Sep 17 2025, 7:57 AM

Change #1189107 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189107

gerritbot added a comment.Sep 17 2025, 7:57 AM

Change #1189108 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189108

gerritbot added a comment.Sep 17 2025, 8:05 AM

Change #1189108 abandoned by Kosta Harlan:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189108

gerritbot added a comment.Sep 17 2025, 8:05 AM

Change #1189107 abandoned by Kosta Harlan:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189107

gerritbot added a comment.Sep 17 2025, 8:06 AM

Change #1189107 restored by Kosta Harlan:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189107

gerritbot added a comment.Sep 17 2025, 8:07 AM

Change #1189108 restored by Kosta Harlan:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189108

gerritbot added a comment.Sep 17 2025, 8:19 AM

Change #1189108 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189108

gerritbot added a comment.Sep 17 2025, 8:22 AM

Change #1189107 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189107

Stashbot added a comment.Sep 17 2025, 8:22 AM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T08:22:46Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1189108|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189107|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189106|hCaptcha: Remove non-existent message]], [[gerrit:1189105|hCaptcha: Remove non-existent message]]

gerritbot added a comment.Sep 17 2025, 8:24 AM

Change #1189040 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Track events via Prometheus

https://gerrit.wikimedia.org/r/1189040

Stashbot added a comment.Sep 17 2025, 8:28 AM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T08:28:42Z] <kharlan@deploy1003> kharlan: Backport for [[gerrit:1189108|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189107|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189106|hCaptcha: Remove non-existent message]], [[gerrit:1189105|hCaptcha: Remove non-existent message]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 17 2025, 8:36 AM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T08:36:28Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1189108|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189107|hCaptcha: Track events via Prometheus (T402767)]], [[gerrit:1189106|hCaptcha: Remove non-existent message]], [[gerrit:1189105|hCaptcha: Remove non-existent message]] (duration: 13m 41s)

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.18; 2025-09-09); removed MW-1.45-notes (1.45.0-wmf.16; 2025-08-26).Sep 17 2025, 9:02 AM
gerritbot added a comment.Sep 17 2025, 11:35 AM

Change #1189137 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189137

gerritbot added a comment.Sep 17 2025, 11:44 AM

Change #1189138 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189138

gerritbot added a comment.Sep 17 2025, 1:58 PM

Change #1189189 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189189

gerritbot added a comment.Sep 17 2025, 1:58 PM

Change #1189191 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189191

gerritbot added a comment.Sep 17 2025, 1:59 PM

Change #1189193 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189193

gerritbot added a comment.Sep 17 2025, 1:59 PM

Change #1189194 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189194

gerritbot added a comment.Sep 17 2025, 2:14 PM

Change #1189137 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189137

gerritbot added a comment.Sep 17 2025, 2:21 PM

Change #1189193 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189193

gerritbot added a comment.Sep 17 2025, 2:21 PM

Change #1189189 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Add wiki label for special_create_account

https://gerrit.wikimedia.org/r/1189189

gerritbot added a comment.Sep 17 2025, 2:22 PM

Change #1189138 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189138

Stashbot added a comment.Sep 17 2025, 2:22 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T14:22:04Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1189189|hCaptcha: Add wiki label for special_create_account (T402767)]], [[gerrit:1189193|hCaptcha: Add wiki label for special_create_account (T402767)]]

Stashbot added a comment.Sep 17 2025, 2:27 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T14:27:46Z] <kharlan@deploy1003> kharlan: Backport for [[gerrit:1189189|hCaptcha: Add wiki label for special_create_account (T402767)]], [[gerrit:1189193|hCaptcha: Add wiki label for special_create_account (T402767)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 17 2025, 2:33 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T14:33:41Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1189189|hCaptcha: Add wiki label for special_create_account (T402767)]], [[gerrit:1189193|hCaptcha: Add wiki label for special_create_account (T402767)]] (duration: 11m 36s)

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.20; 2025-09-23); removed MW-1.45-notes (1.45.0-wmf.18; 2025-09-09).Sep 17 2025, 3:00 PM
gerritbot added a comment.Sep 17 2025, 6:55 PM

Change #1189194 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189194

gerritbot added a comment.Sep 17 2025, 6:55 PM

Change #1189191 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.18] hCaptcha: Log open events to Prometheus

https://gerrit.wikimedia.org/r/1189191

Stashbot added a comment.Sep 17 2025, 6:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T18:55:57Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1189194|hCaptcha: Log open events to Prometheus (T402767)]], [[gerrit:1189191|hCaptcha: Log open events to Prometheus (T402767)]]

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.19; 2025-09-16); removed MW-1.45-notes (1.45.0-wmf.20; 2025-09-23).Sep 17 2025, 7:00 PM
Stashbot added a comment.Sep 17 2025, 7:01 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T19:01:33Z] <kharlan@deploy1003> kharlan: Backport for [[gerrit:1189194|hCaptcha: Log open events to Prometheus (T402767)]], [[gerrit:1189191|hCaptcha: Log open events to Prometheus (T402767)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 17 2025, 7:07 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-17T19:07:25Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1189194|hCaptcha: Log open events to Prometheus (T402767)]], [[gerrit:1189191|hCaptcha: Log open events to Prometheus (T402767)]] (duration: 11m 28s)

kostajh moved this task from Backlog to In progress on the WE4.2 Bot detection (WE4.2 hCaptcha account creation trial) board.Sep 18 2025, 6:23 AM
kostajh added a project: Trust and Safety Product Sprint (Sprint Dadar Gulung (September 8 - September 26)).
gerritbot added a comment.Sep 18 2025, 9:31 AM

Change #1189442 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log hcaptcha.execute() events

https://gerrit.wikimedia.org/r/1189442

gerritbot added a comment.Sep 18 2025, 2:20 PM

Change #1189500 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Log hcaptcha.execute() events

https://gerrit.wikimedia.org/r/1189500

gerritbot added a comment.Sep 18 2025, 2:46 PM

Change #1189442 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log hcaptcha.execute() events

https://gerrit.wikimedia.org/r/1189442

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.20; 2025-09-23); removed MW-1.45-notes (1.45.0-wmf.19; 2025-09-16).Sep 18 2025, 3:00 PM
gerritbot added a comment.Sep 18 2025, 3:28 PM

Change #1189500 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.45.0-wmf.19] hCaptcha: Log hcaptcha.execute() events

https://gerrit.wikimedia.org/r/1189500

Stashbot added a comment.Sep 18 2025, 3:29 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-18T15:29:19Z] <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1189500|hCaptcha: Log hcaptcha.execute() events (T402767)]]

Stashbot added a comment.Sep 18 2025, 3:35 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-18T15:35:40Z] <kharlan@deploy1003> kharlan: Backport for [[gerrit:1189500|hCaptcha: Log hcaptcha.execute() events (T402767)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 18 2025, 3:41 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-18T15:41:40Z] <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1189500|hCaptcha: Log hcaptcha.execute() events (T402767)]] (duration: 12m 20s)

ReleaseTaggerBot edited projects, added MW-1.45-notes (1.45.0-wmf.19; 2025-09-16); removed MW-1.45-notes (1.45.0-wmf.20; 2025-09-23).Sep 18 2025, 4:00 PM
kostajh updated the task description. (Show Details)Sep 22 2025, 10:35 AM
kostajh moved this task from Priority Backlog to Done on the Trust and Safety Product Sprint (Sprint Dadar Gulung (September 8 - September 26)) board.
kostajh added a subscriber: sguebo_WMF.

@sguebo_WMF can you please review, and close this task if you think there's nothing more to be done?

kostajh moved this task from In progress to Done on the WE4.2 Bot detection (WE4.2 hCaptcha account creation trial) board.Sep 22 2025, 10:55 AM
sguebo_WMF closed this task as Resolved.Sep 22 2025, 3:10 PM
gerritbot added a comment.Fri, Nov 14, 3:51 PM

Change #1205184 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Track the interfaceName in open-callback events

https://gerrit.wikimedia.org/r/1205184

gerritbot added a comment.Fri, Nov 14, 8:54 PM

Change #1205184 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Track the interfaceName in open-callback events

https://gerrit.wikimedia.org/r/1205184

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Fri, Nov 14, 9:00 PM
gerritbot added a comment.Fri, Nov 14, 9:08 PM

Change #1205224 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ConfirmEdit@wmf/1.46.0-wmf.2] hCaptcha: Track the interfaceName in open-callback events

https://gerrit.wikimedia.org/r/1205224

gerritbot added a comment.Mon, Nov 17, 8:09 AM

Change #1205224 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.46.0-wmf.2] hCaptcha: Track the interfaceName in open-callback events

https://gerrit.wikimedia.org/r/1205224

Stashbot added a comment.Mon, Nov 17, 8:11 AM

Mentioned in SAL (#wikimedia-operations) [2025-11-17T08:11:15Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1205558|hCaptcha: Record hcaptcha.execute() calls in VisualEditorFeatureUse (T410146)]], [[gerrit:1205224|hCaptcha: Track the interfaceName in open-callback events (T410008 T402767)]]

Stashbot mentioned this in T410008: hCaptcha: Update Grafana dashboard to include editing events.Mon, Nov 17, 8:11 AM
Stashbot mentioned this in T410146: hCaptcha: Generate VisualEditorFeatureUse event when hCaptcha execute is invoked.
Stashbot added a comment.Mon, Nov 17, 8:36 AM

Mentioned in SAL (#wikimedia-operations) [2025-11-17T08:36:09Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1205558|hCaptcha: Record hcaptcha.execute() calls in VisualEditorFeatureUse (T410146)]], [[gerrit:1205224|hCaptcha: Track the interfaceName in open-callback events (T410008 T402767)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Mon, Nov 17, 8:53 AM

Mentioned in SAL (#wikimedia-operations) [2025-11-17T08:53:15Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1205558|hCaptcha: Record hcaptcha.execute() calls in VisualEditorFeatureUse (T410146)]], [[gerrit:1205224|hCaptcha: Track the interfaceName in open-callback events (T410008 T402767)]] (duration: 42m 00s)

ReleaseTaggerBot edited projects, added MW-1.46-notes (1.46.0-wmf.2; 2025-11-12); removed MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Mon, Nov 17, 9:01 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits