Page MenuHomePhabricator
Create Task
Maniphest T414703

Deploy the opensearch-semantic-search opensearch 3.x clusters
Closed, ResolvedPublic
Actions

Description

These clusters will be deployed to both dse-k8s-eqiad and dse-k8s-codfw, and should at be able to store 4.5TB of data.

We don't have a firm RAM/CPU requirement at the moment, so we should probably started with something medium-sized and adjust as required.

We're targeting a load/performance baseline of of 5-10 API qps.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
dse-k8s: increase mem/cpu quotas for the opensearch-semantic-search nsoperations/deployment-chartsmaster+9 -1
dse-k8s: add opensearch-semantic-search recordsoperations/dnsmaster+6 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

brouberol created this task.Jan 15 2026, 4:10 PM
brouberol triaged this task as Medium priority.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 15 2026, 4:10 PM
brouberol added a subtask: T414691: Deploy the opensearch semantic-search cluster on dse-k8s-eqiad.Jan 15 2026, 4:10 PM
brouberol added a subtask: T414692: Deploy the opensearch semantic-search cluster on dse-k8s-codfw.
brouberol updated the task description. (Show Details)Jan 15 2026, 4:16 PM
brouberol updated the task description. (Show Details)Jan 15 2026, 4:22 PM
dr0ptp4kt subscribed.Jan 16 2026, 12:55 AM
Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.Jan 22 2026, 2:38 PM
Gehel edited projects, added Data-Platform-SRE (2026.01.05 - 2026.01.23); removed Data-Platform-SRE.
Gehel edited projects, added Data-Platform-SRE (2026.01.23 - 2026.02.13); removed Data-Platform-SRE (2026.01.05 - 2026.01.23).Jan 23 2026, 10:04 AM
gerritbot added a comment.Feb 5 2026, 2:38 PM

Change #1237236 had a related patch set uploaded (by Bking; author: Bking):

[operations/dns@master] dse-k8s: add opensearch-semantic-search records

https://gerrit.wikimedia.org/r/1237236

gerritbot added a project: Patch-For-Review.Feb 5 2026, 2:38 PM
gerritbot added a comment.Feb 5 2026, 2:40 PM

Change #1237236 merged by Bking:

[operations/dns@master] dse-k8s: add opensearch-semantic-search records

https://gerrit.wikimedia.org/r/1237236

Maintenance_bot removed a project: Patch-For-Review.Feb 5 2026, 3:32 PM
RKemper closed subtask T414691: Deploy the opensearch semantic-search cluster on dse-k8s-eqiad as Resolved.Feb 7 2026, 5:33 AM
RKemper closed subtask T414692: Deploy the opensearch semantic-search cluster on dse-k8s-codfw as Resolved.Tue, Feb 10, 10:12 PM
Gehel edited projects, added Data-Platform-SRE (2026-02-13 - 2026-03-06); removed Data-Platform-SRE (2026.01.23 - 2026.02.13).Mon, Feb 16, 3:36 PM
Gehel closed this task as Resolved.Tue, Feb 17, 2:45 PM
Gehel claimed this task.
Gehel moved this task from Backlog - project to Done on the Data-Platform-SRE (2026-02-13 - 2026-03-06) board.
Gehel moved this task from Done to Reported on the Data-Platform-SRE (2026-02-13 - 2026-03-06) board.Fri, Feb 20, 9:11 AM
gerritbot added a comment.Tue, Mar 3, 10:20 AM

Change #1247548 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] dse-k8s: increase mem/cpu quotas for the opensearch-semantic-search ns

https://gerrit.wikimedia.org/r/1247548

gerritbot added a project: Patch-For-Review.Tue, Mar 3, 10:20 AM
gerritbot added a comment.Tue, Mar 3, 10:30 AM

Change #1247548 merged by Brouberol:

[operations/deployment-charts@master] dse-k8s: increase mem/cpu quotas for the opensearch-semantic-search ns

https://gerrit.wikimedia.org/r/1247548

Maintenance_bot removed a project: Patch-For-Review.Tue, Mar 3, 10:31 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits