Page MenuHomePhabricator
Create Task
Maniphest T410615

Update Extension:IPReputation to support OpenSearch
Closed, ResolvedPublic
Actions

Description

Summary

Extension:IPReputation currently knows how to read from the NodeJS IPoid application. We need to update it to support reading from OpenSearch IPoid.

Acceptance criteria

  • Configuration options exist in Extension:IPReputation so that it can read from OpenSearch and be backwards compatible with the existing NodeJS IPoid data source

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
IPReputation: Enable OpenSearch IPoid provider on testwikiKosta Harlanoperations/mediawiki-configmaster+6 -0
IPoidDataLookup: Support querying OpenSearchKosta Harlanmediawiki/extensions/IPReputationmaster+221 -0
IPoid: Support additional fieldsKosta Harlanmediawiki/extensions/IPReputationmaster+51 -0
IPoidDataLookup: Refactor lookup to support multiple backendsKosta Harlanmediawiki/extensions/IPReputationmaster+366 -265
IPReputation: Define data provider, URL and developer mode configKosta Harlanoperations/mediawiki-configmaster+3 -0
maintenance: Add a GetIPReputationData scriptKosta Harlanmediawiki/extensions/IPReputationmaster+47 -0
IPoidDataLookup: Move configuration check handlingKosta Harlanmediawiki/extensions/IPReputationmaster+11 -11
Customize query in gerrit

Related Objects
Search...

Event Timeline

kostajh created this task.Nov 20 2025, 12:17 PM
gerritbot added a comment.Nov 20 2025, 12:19 PM

Change #1207831 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/IPReputation@master] maintenance: Add a GetIPReputationData script

https://gerrit.wikimedia.org/r/1207831

gerritbot added a project: Patch-For-Review.Nov 20 2025, 12:19 PM
kostajh added a project: MediaWiki-extensions-IPReputation.Nov 20 2025, 12:30 PM
gerritbot added a comment.Nov 20 2025, 12:33 PM

Change #1207838 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/IPReputation@master] IPoidDataLookup: Move configuration check handling

https://gerrit.wikimedia.org/r/1207838

gerritbot added a comment.Nov 20 2025, 12:37 PM

Change #1207840 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/IPReputation@master] (WIP) IPoidDataLookup: Support querying OpenSearch

https://gerrit.wikimedia.org/r/1207840

kostajh claimed this task.Nov 26 2025, 2:49 PM
kostajh edited projects, added: Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)); removed: Product Safety and Integrity.Dec 18 2025, 1:47 PM
kostajh moved this task from Backlog to In progress on the Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)) board.Dec 18 2025, 1:55 PM
gerritbot added a comment.Dec 18 2025, 2:22 PM

Change #1207831 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] maintenance: Add a GetIPReputationData script

https://gerrit.wikimedia.org/r/1207831

gerritbot added a comment.Dec 18 2025, 2:22 PM

Change #1207838 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] IPoidDataLookup: Move configuration check handling

https://gerrit.wikimedia.org/r/1207838

jenkins-bot mentioned this in rEIPR925541d599bf: maintenance: Add a GetIPReputationData script.Dec 18 2025, 2:22 PM
jenkins-bot mentioned this in rEIPR5f438a3856bf: IPoidDataLookup: Move configuration check handling.
kostajh moved this task from In progress to Needs review on the Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)) board.Jan 5 2026, 2:07 PM
gerritbot added a comment.Jan 6 2026, 10:35 AM

Change #1223635 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] IPReputation: Define data provider, URL and developer mode config

https://gerrit.wikimedia.org/r/1223635

gerritbot added a comment.Jan 6 2026, 10:42 AM

Change #1223636 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] IPReputation: Enable OpenSearch IPoid provider on testwiki

https://gerrit.wikimedia.org/r/1223636

gerritbot added a comment.Jan 16 2026, 9:21 AM

Change #1227711 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/IPReputation@master] IPoidDataLookup: Refactor lookup to support multiple backends

https://gerrit.wikimedia.org/r/1227711

gerritbot added a comment.Jan 16 2026, 9:42 AM

Change #1227722 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/IPReputation@master] IPoid: Support additional fields

https://gerrit.wikimedia.org/r/1227722

gerritbot added a comment.Jan 19 2026, 2:38 PM

Change #1223635 merged by jenkins-bot:

[operations/mediawiki-config@master] IPReputation: Define data provider, URL and developer mode config

https://gerrit.wikimedia.org/r/1223635

Stashbot added a comment.Jan 19 2026, 2:38 PM

Mentioned in SAL (#wikimedia-operations) [2026-01-19T14:38:53Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1223635|IPReputation: Define data provider, URL and developer mode config (T410615)]]

Stashbot added a comment.Jan 19 2026, 2:40 PM

Mentioned in SAL (#wikimedia-operations) [2026-01-19T14:40:47Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1223635|IPReputation: Define data provider, URL and developer mode config (T410615)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jan 19 2026, 2:51 PM

Mentioned in SAL (#wikimedia-operations) [2026-01-19T14:51:02Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1223635|IPReputation: Define data provider, URL and developer mode config (T410615)]] (duration: 12m 09s)

gerritbot added a comment.Jan 19 2026, 4:01 PM

Change #1227711 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] IPoidDataLookup: Refactor lookup to support multiple backends

https://gerrit.wikimedia.org/r/1227711

gerritbot added a comment.Jan 19 2026, 4:01 PM

Change #1227722 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] IPoid: Support additional fields

https://gerrit.wikimedia.org/r/1227722

jenkins-bot mentioned this in rEIPRebb5724b7cca: IPoid: Support additional fields.Jan 19 2026, 4:02 PM
jenkins-bot mentioned this in rEIPRcfbd80820667: IPoidDataLookup: Refactor lookup to support multiple backends.
gerritbot added a comment.Jan 19 2026, 4:04 PM

Change #1207840 merged by jenkins-bot:

[mediawiki/extensions/IPReputation@master] IPoidDataLookup: Support querying OpenSearch

https://gerrit.wikimedia.org/r/1207840

jenkins-bot mentioned this in rEIPR41abade5b078: IPoidDataLookup: Support querying OpenSearch.Jan 19 2026, 4:05 PM
gerritbot added a comment.Jan 20 2026, 8:32 AM

Change #1223636 merged by jenkins-bot:

[operations/mediawiki-config@master] IPReputation: Enable OpenSearch IPoid provider on testwiki

https://gerrit.wikimedia.org/r/1223636

Stashbot added a comment.Jan 20 2026, 8:33 AM

Mentioned in SAL (#wikimedia-operations) [2026-01-20T08:33:47Z] <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1223636|IPReputation: Enable OpenSearch IPoid provider on testwiki (T410615)]]

Stashbot added a comment.Jan 20 2026, 8:36 AM

Mentioned in SAL (#wikimedia-operations) [2026-01-20T08:36:02Z] <kharlan@deploy2002> kharlan: Backport for [[gerrit:1223636|IPReputation: Enable OpenSearch IPoid provider on testwiki (T410615)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jan 20 2026, 8:45 AM

Mentioned in SAL (#wikimedia-operations) [2026-01-20T08:45:30Z] <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1223636|IPReputation: Enable OpenSearch IPoid provider on testwiki (T410615)]] (duration: 11m 43s)

kostajh moved this task from Needs review to Needs QA on the Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)) board.Jan 20 2026, 9:21 AM
kostajh updated the task description. (Show Details)
Maintenance_bot removed a project: Patch-For-Review.Jan 20 2026, 9:33 AM
OKryva-WMF edited projects, added: Product Safety and Integrity (Sprint Daffodil (Jan 19 - Feb 6)), Essential-Work; removed: Product Safety and Integrity (Essential Work Sprint (Dec 15th - Jan 9th)).Jan 20 2026, 1:00 PM
OKryva-WMF moved this task from Backlog to Needs QA on the Product Safety and Integrity (Sprint Daffodil (Jan 19 - Feb 6)) board.
OKryva-WMF edited projects, added: Product Safety and Integrity (Sprint Flower (Feb 9 - Feb 27)); removed: Product Safety and Integrity (Sprint Daffodil (Jan 19 - Feb 6)).Feb 10 2026, 9:07 AM
OKryva-WMF moved this task from Backlog to Needs QA on the Product Safety and Integrity (Sprint Flower (Feb 9 - Feb 27)) board.Feb 10 2026, 9:07 AM
kostajh closed this task as Resolved.Feb 24 2026, 8:06 AM
kostajh moved this task from Needs QA to Done on the Product Safety and Integrity (Sprint Flower (Feb 9 - Feb 27)) board.
JMeybohm reopened this task as Open.EditedMar 23 2026, 10:02 AM
JMeybohm subscribed.

With the current configuration and the fact that it is bypassing the service mesh calls are without session reuse. This makes them very(!) expensive (especially for cross DC traffic).
Please migrate this to using the service mesh as soon as possible.

JMeybohm mentioned this in T406876: Ensure external access to opensearch-test cluster.Mar 23 2026, 10:08 AM
kostajh closed this task as Resolved.Fri, Jul 10, 11:23 AM
In T410615#11737400, @JMeybohm wrote:

With the current configuration and the fact that it is bypassing the service mesh calls are without session reuse. This makes them very(!) expensive (especially for cross DC traffic).
Please migrate this to using the service mesh as soon as possible.

This was done a while ago.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits