hCaptcha: Track events for edits in Prometheus
Closed, ResolvedPublic
Actions

Description

Summary

As discussed here, we would need to extend the instrumentation code in ConfirmEdit in order to fire and track events caused by interactions while editing.

Patch to fire tracking events when the challenge is open/closed/expired or has an error: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ConfirmEdit/+/1196718/5
Instrumentation code in WikimediaEvents, currently filtering events not associated with account creations: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/1196719

Acceptance criteria

ConfirmEdit fires events for interactions done while editing
WikimediaEvents submits interaction events in response to the events from ConfirmEdit

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
hCaptcha instrumentation: Handle hcaptcha.render events during edits	mediawiki/extensions/WikimediaEvents	master	+97 -0
Move ext.wikimediaEvents.createAccount to ext.wikimediaEvents	mediawiki/extensions/WikimediaEvents	master	+11 -105
ext.confirmEdit.hCaptcha: Consider action=submit an edit interface	mediawiki/extensions/ConfirmEdit	wmf/1.46.0-wmf.2	+1 -1
hCaptcha instrumentation: Handle hcaptcha.render events during edits	mediawiki/extensions/WikimediaEvents	wmf/1.46.0-wmf.2	+97 -0
ext.confirmEdit.hCaptcha: Consider action=submit an edit interface	mediawiki/extensions/ConfirmEdit	master	+1 -1

Customize query in gerrit

Related Objects

Mentioned In: T405597: hCaptcha: Update instrumentation for risk score
T409701: hCaptcha: Log challenge event as "saveFailure" in EditAttemptStep
T409825: hCaptcha: Log error codes in Prometheus and event logging events
T409703: hCaptcha: Log challenge close and expiry events to VisualEditorFeatureUse
Mentioned Here: T405597: hCaptcha: Update instrumentation for risk score
T409701: hCaptcha: Log challenge event as "saveFailure" in EditAttemptStep
T409703: hCaptcha: Log challenge close and expiry events to VisualEditorFeatureUse

Event Timeline

hector.arroyo created this task.Nov 6 2025, 10:51 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 6 2025, 10:51 AM

hector.arroyo updated the task description. (Show Details)Nov 6 2025, 10:52 AM

kostajh edited projects, added WE4.2 Bot detection (WE4.2 hCaptcha editing trial), Product Safety and Integrity (Crepes au Chocolat (Sprint Nov 10 - Nov 28)); removed Product Safety and Integrity.Nov 10 2025, 8:47 PM

kostajh moved this task from Backlog to Ready on the WE4.2 Bot detection (WE4.2 hCaptcha editing trial) board.Nov 11 2025, 9:13 AM

kostajh renamed this task from hCaptcha: Track events for edits to hCaptcha: Track events for edits in Prometheus.Nov 11 2025, 9:46 AM

kostajh assigned this task to Dreamy_Jazz.Nov 11 2025, 10:19 AM

kostajh moved this task from Ready to In progress on the WE4.2 Bot detection (WE4.2 hCaptcha editing trial) board.Nov 11 2025, 12:11 PM

kostajh mentioned this in T409703: hCaptcha: Log challenge close and expiry events to VisualEditorFeatureUse.

OKryva-WMF moved this task from Backlog to In progress on the Product Safety and Integrity (Crepes au Chocolat (Sprint Nov 10 - Nov 28)) board.Nov 11 2025, 12:48 PM

kostajh mentioned this in T409825: hCaptcha: Log error codes in Prometheus and event logging events.Nov 11 2025, 1:13 PM

Note that this task should result in ext.wikimediaEvents.createAccount being refactored such that it can contain code for Prometheus and event logging (metrics platform) for both account creations and edits.

Change #1203836 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] [WIP] Move ext.wikimediaEvents.createAccount to ext.wikimediaEvents

https://gerrit.wikimedia.org/r/1203836

gerritbot added a project: Patch-For-Review.Nov 11 2025, 3:12 PM

Change #1204076 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@master] hCaptcha instrumentation: Handle hcaptcha.render events during edits

https://gerrit.wikimedia.org/r/1204076

Dreamy_Jazz moved this task from In progress to Needs review on the Product Safety and Integrity (Crepes au Chocolat (Sprint Nov 10 - Nov 28)) board.Nov 11 2025, 6:59 PM

Change #1204078 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/ConfirmEdit@master] ext.confirmEdit.hCaptcha: Consider action=submit an edit interface

https://gerrit.wikimedia.org/r/1204078

Change #1204078 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@master] ext.confirmEdit.hCaptcha: Consider action=submit an edit interface

https://gerrit.wikimedia.org/r/1204078

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Nov 11 2025, 9:00 PM

Change #1204088 had a related patch set uploaded (by Kosta Harlan; author: Dreamy Jazz):

[mediawiki/extensions/ConfirmEdit@wmf/1.46.0-wmf.2] ext.confirmEdit.hCaptcha: Consider action=submit an edit interface

https://gerrit.wikimedia.org/r/1204088

Change #1204076 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] hCaptcha instrumentation: Handle hcaptcha.render events during edits

https://gerrit.wikimedia.org/r/1204076

Change #1204238 had a related patch set uploaded (by Kosta Harlan; author: Dreamy Jazz):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.2] hCaptcha instrumentation: Handle hcaptcha.render events during edits

https://gerrit.wikimedia.org/r/1204238

Change #1204238 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.2] hCaptcha instrumentation: Handle hcaptcha.render events during edits

https://gerrit.wikimedia.org/r/1204238

Mentioned in SAL (#wikimedia-operations) [2025-11-12T08:49:09Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1204238|hCaptcha instrumentation: Handle hcaptcha.render events during edits (T409701 T409703 T409415)]]

Stashbot mentioned this in T409701: hCaptcha: Log challenge event as "saveFailure" in EditAttemptStep.Nov 12 2025, 8:49 AM

Mentioned in SAL (#wikimedia-operations) [2025-11-12T08:51:23Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1204238|hCaptcha instrumentation: Handle hcaptcha.render events during edits (T409701 T409703 T409415)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-11-12T08:58:27Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1204238|hCaptcha instrumentation: Handle hcaptcha.render events during edits (T409701 T409703 T409415)]] (duration: 09m 17s)

ReleaseTaggerBot edited projects, added MW-1.46-notes (1.46.0-wmf.2; 2025-11-12); removed MW-1.46-notes (1.46.0-wmf.3; 2025-11-19).Nov 12 2025, 9:00 AM

Change #1204088 merged by jenkins-bot:

[mediawiki/extensions/ConfirmEdit@wmf/1.46.0-wmf.2] ext.confirmEdit.hCaptcha: Consider action=submit an edit interface

https://gerrit.wikimedia.org/r/1204088

Mentioned in SAL (#wikimedia-operations) [2025-11-12T09:13:28Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1204088|ext.confirmEdit.hCaptcha: Consider action=submit an edit interface (T409701 T409703 T409415)]], [[gerrit:1204163|Refactor CaptchaScoreHooks to use EventSubmitter (T405597)]]

Mentioned in SAL (#wikimedia-operations) [2025-11-12T09:15:49Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1204088|ext.confirmEdit.hCaptcha: Consider action=submit an edit interface (T409701 T409703 T409415)]], [[gerrit:1204163|Refactor CaptchaScoreHooks to use EventSubmitter (T405597)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-11-12T09:22:49Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1204088|ext.confirmEdit.hCaptcha: Consider action=submit an edit interface (T409701 T409703 T409415)]], [[gerrit:1204163|Refactor CaptchaScoreHooks to use EventSubmitter (T405597)]] (duration: 09m 21s)