Page MenuHomePhabricator
Create Task
Maniphest T406865

hCaptcha: Implement mechanism to log about-to-be-published content when challenge is presented
Open, In Progress, Needs TriagePublic
Actions

Description

Summary

hCaptcha is configured in 99.9% passive mode. A challenge is presented when hCaptcha suspects a bot is involved. In these cases, we want to record the diff of the existing content to proposed new editor content, so we can analyze if the content was likely spam

Technical notes

  • Rely on confirmEditMerged hook to detect when challenge is presented after edit change, and compute diff change, and send a backend event to a schema
  • Add a separate schema to the schemas-event-secondary repo ( with a field proposed_content_diff which would be a unified diff string, T408613)

Acceptance criteria

  • The proposed changes to a page from an editor are logged in an event logging stream for further analysis when a challenge is presented

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
hCaptcha: Log diff when challenge is presentedmediawiki/extensions/WikimediaEventswmf/1.46.0-wmf.4+492 -0
Refactor: Move editing session ID logic into servicemediawiki/extensions/WikimediaEventswmf/1.46.0-wmf.4+48 -7
Set new $wgRateLimits config for edit attempt logoperations/mediawiki-configmaster+6 -0
EventLogging: Register mediawiki.hcaptcha.edit streamoperations/mediawiki-configmaster+12 -0
hCaptcha: Log diff when challenge is presentedmediawiki/extensions/WikimediaEventsmaster+492 -0
Refactor: Move editing session ID logic into servicemediawiki/extensions/WikimediaEventsmaster+48 -7
hCaptcha: Log edit diff when challenge is shownmediawiki/extensions/ConfirmEditmaster+300 -0
Zuul: ConfirmEdit extension: Add EventLogging dependencyintegration/configmaster+2 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

kostajh created this task.Oct 9 2025, 1:30 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 9 2025, 1:30 PM
kostajh added a project: ConfirmEdit (CAPTCHA extension).Oct 9 2025, 1:30 PM
sguebo_WMF changed the task status from Open to In Progress.Nov 1 2025, 3:07 AM
sguebo_WMF claimed this task.
sguebo_WMF updated the task description. (Show Details)
sguebo_WMF moved this task from Backlog to In progress on the WE4.2 Bot detection (WE4.2 hCaptcha editing trial) board.
sguebo_WMF updated the task description. (Show Details)Nov 1 2025, 3:32 AM
sguebo_WMF updated the task description. (Show Details)
sguebo_WMF added a subtask: T408613: hCaptcha: Update EditAttemptStep in order to log an event when the a visual challenge is encountered.
sguebo_WMF changed the status of subtask T408613: hCaptcha: Update EditAttemptStep in order to log an event when the a visual challenge is encountered from Open to In Progress.Nov 1 2025, 3:35 AM
CodeReviewBot added a project: Patch-For-Review.Nov 2 2025, 3:36 AM

sguebo opened https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/92

Add proposed_content_diff to EditAttemptStep schema

gerritbot added a comment.Nov 4 2025, 2:44 AM

Change #1200439 had a related patch set uploaded (by Samuel (WMF); author: Samuel (WMF)):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log edit diff when challenge is shown

https://gerrit.wikimedia.org/r/1200439

gerritbot added a comment.Nov 4 2025, 2:54 PM

Change #1201694 had a related patch set uploaded (by Samuel (WMF); author: Samuel (WMF)):

[integration/config@master] Zuul: ConfirmEdit extension: Add EventLogging dependecy

https://gerrit.wikimedia.org/r/1201694

gerritbot added a comment.Nov 4 2025, 3:18 PM

Change #1201694 abandoned by Samuel (WMF):

[integration/config@master] Zuul: ConfirmEdit extension: Add EventLogging dependency

Reason:

We agreed on keeping instrumentation code in EventLogging, rather than moving it to ConfirmEdit.

https://gerrit.wikimedia.org/r/1201694

sguebo_WMF updated the task description. (Show Details)Nov 4 2025, 4:19 PM
gerritbot added a comment.Nov 6 2025, 7:28 AM

Change #1200439 abandoned by Samuel (WMF):

[mediawiki/extensions/ConfirmEdit@master] hCaptcha: Log edit diff when challenge is shown

Reason:

Logic will be moved to a separate patch in WikimediaEvents extension, rather than ConfirmEdit

https://gerrit.wikimedia.org/r/1200439

gerritbot added a comment.Nov 6 2025, 8:25 AM

Change #1202641 had a related patch set uploaded (by Samuel (WMF); author: Samuel (WMF)):

[mediawiki/extensions/WikimediaEvents@master] Log edit diff when hCaptcha challenge is shown

https://gerrit.wikimedia.org/r/1202641

gerritbot added a comment.Wed, Nov 26, 1:21 AM

Change #1211295 had a related patch set uploaded (by Samuel (WMF); author: Samuel (WMF)):

[operations/mediawiki-config@master] Set $wgRateLimits['hcaptchaedit'] for edit attempt log

https://gerrit.wikimedia.org/r/1211295

gerritbot added a comment.Sat, Nov 29, 3:13 AM

Change #1212816 had a related patch set uploaded (by Samuel (WMF); author: Samuel (WMF)):

[mediawiki/extensions/WikimediaEvents@master] Refactor: Move editing session ID logic into service

https://gerrit.wikimedia.org/r/1212816

gerritbot added a comment.Mon, Dec 1, 1:56 PM

Change #1213468 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] EventLogging: Register mediawiki.hcaptcha.edit stream

https://gerrit.wikimedia.org/r/1213468

gerritbot added a comment.Mon, Dec 1, 1:57 PM

Change #1212816 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Refactor: Move editing session ID logic into service

https://gerrit.wikimedia.org/r/1212816

CodeReviewBot added a comment.Mon, Dec 1, 1:58 PM

kharlan merged https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary/-/merge_requests/92

Add hCaptcha/edit schema

gerritbot added a comment.Mon, Dec 1, 2:44 PM

Change #1202641 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] hCaptcha: Log diff when challenge is presented

https://gerrit.wikimedia.org/r/1202641

gerritbot added a comment.Mon, Dec 1, 3:00 PM

Change #1213468 merged by jenkins-bot:

[operations/mediawiki-config@master] EventLogging: Register mediawiki.hcaptcha.edit stream

https://gerrit.wikimedia.org/r/1213468

gerritbot added a comment.Mon, Dec 1, 3:00 PM

Change #1211295 merged by jenkins-bot:

[operations/mediawiki-config@master] Set new $wgRateLimits config for edit attempt log

https://gerrit.wikimedia.org/r/1211295

Stashbot added a comment.Mon, Dec 1, 3:01 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-01T15:01:17Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1213468|EventLogging: Register mediawiki.hcaptcha.edit stream (T406865)]], [[gerrit:1211295|Set new $wgRateLimits config for edit attempt log (T406865)]]

Stashbot added a comment.Mon, Dec 1, 3:03 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-01T15:03:18Z] <kharlan@deploy2002> kharlan, sguebo: Backport for [[gerrit:1213468|EventLogging: Register mediawiki.hcaptcha.edit stream (T406865)]], [[gerrit:1211295|Set new $wgRateLimits config for edit attempt log (T406865)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Mon, Dec 1, 3:12 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-01T15:12:20Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1213468|EventLogging: Register mediawiki.hcaptcha.edit stream (T406865)]], [[gerrit:1211295|Set new $wgRateLimits config for edit attempt log (T406865)]] (duration: 11m 03s)

Maintenance_bot removed a project: Patch-For-Review.Mon, Dec 1, 3:31 PM
ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.5; 2025-12-02).Mon, Dec 1, 4:00 PM
gerritbot added a comment.Tue, Dec 2, 4:12 PM

Change #1214101 had a related patch set uploaded (by Kosta Harlan; author: Samuel (WMF)):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.4] Refactor: Move editing session ID logic into service

https://gerrit.wikimedia.org/r/1214101

gerritbot added a project: Patch-For-Review.Tue, Dec 2, 4:12 PM

Change #1214102 had a related patch set uploaded (by Kosta Harlan; author: Samuel (WMF)):

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.4] hCaptcha: Log diff when challenge is presented

https://gerrit.wikimedia.org/r/1214102

gerritbot added a comment.Tue, Dec 2, 8:29 PM

Change #1214101 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.4] Refactor: Move editing session ID logic into service

https://gerrit.wikimedia.org/r/1214101

gerritbot added a comment.Tue, Dec 2, 8:29 PM

Change #1214102 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.46.0-wmf.4] hCaptcha: Log diff when challenge is presented

https://gerrit.wikimedia.org/r/1214102

Stashbot added a comment.Tue, Dec 2, 8:30 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T20:30:02Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1214101|Refactor: Move editing session ID logic into service (T406865)]], [[gerrit:1214102|hCaptcha: Log diff when challenge is presented (T406865)]]

Maintenance_bot removed a project: Patch-For-Review.Tue, Dec 2, 8:30 PM
ReleaseTaggerBot edited projects, added MW-1.46-notes (1.46.0-wmf.4; 2025-11-25); removed MW-1.46-notes (1.46.0-wmf.5; 2025-12-02).Tue, Dec 2, 9:00 PM
Stashbot added a comment.Tue, Dec 2, 9:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T21:15:55Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1214101|Refactor: Move editing session ID logic into service (T406865)]], [[gerrit:1214102|hCaptcha: Log diff when challenge is presented (T406865)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Tue, Dec 2, 9:29 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T21:29:08Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1214101|Refactor: Move editing session ID logic into service (T406865)]], [[gerrit:1214102|hCaptcha: Log diff when challenge is presented (T406865)]] (duration: 59m 06s)

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits