Page MenuHomePhabricator
Create Task
Maniphest T347075

Deploy test instance of cirrus updater in k8s
Closed, ResolvedPublic8 Estimated Story Points
Actions

Description

Tracking task for deployment of test instance of cirrus updater in k8s
AC:

  • Create swift auth / buckets
  • Confirm and deploy topic filtering (suggested to use testwiki only)
    • Confirm all streams and scheme are properly configured in meta's eventstream config.
  • Point cirrus updater test at relforge ES cluster.
  • Cirrus needs to start emitting the rerender events in T325565 (could happen post-deploy)
  • Create new release of the updater

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
cirrus-streaming-updater: bump vers (NPE fix)operations/deployment-chartsmaster+2 -2
cirrus updater: Disable the all-matching http route in stagingoperations/deployment-chartsmaster+5 -5
relforge: Allow traffic from staging wikikubeoperations/puppetproduction+1 -1
cirrus updater: Provide elasticsearch routesoperations/deployment-chartsmaster+8 -3
cirrus updater: Ensure all output topics existoperations/deployment-chartsmaster+4 -3
cirrus updater: Update container imageoperations/deployment-chartsmaster+1 -1
cirrus updater: Update container imageoperations/deployment-chartsmaster+1 -1
cirrus updater: Read codfw events in stagingoperations/deployment-chartsmaster+3 -1
kafka-main: Allow connections from wikikube-stagingoperations/puppetproduction+5 -0
cirrus updater: pipeline.name is a required parameteroperations/deployment-chartsmaster+1 -0
cirrus updater: topic-prefix-filter must be plain string prefixoperations/deployment-chartsmaster+4 -4
cirrus updater: Adjust event stream http route to match updated configoperations/deployment-chartsmaster+3 -4
cirrus-updater: Add routes for event stream to use local proxy for schema accessoperations/deployment-chartsmaster+6 -3
cirrus-streaming-updater: Enable s3 for state storageoperations/deployment-chartsmaster+2 -2
cirrus-streaming-updater: Correctly define the entry classoperations/deployment-chartsmaster+6 -3
flink-zk: Permit traffic from STAGING_KUBEPODS_NETWORKSoperations/puppetproduction+1 -1
admin: Add cirrus-streaming-updater namespace to flink operatoroperations/deployment-chartsmaster+1 -0
cirrus streaming updater serviceoperations/deployment-chartsmaster+436 -0
cirrus: create new namespaceoperations/deployment-chartsmaster+1 -0
wikikube: prepare new cirrus-streaming-updater serviceoperations/puppetproduction+4 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
EBernhardson updated the task description. (Show Details)Sep 22 2023, 7:09 PM
EBernhardson updated the task description. (Show Details)Sep 22 2023, 8:11 PM
EBernhardson added a comment.Sep 27 2023, 4:40 PM

swift created in T342620. Need to update the chart, and figure out how secrets get from wherever the password is today into the chart.

EBernhardson updated the task description. (Show Details)Sep 27 2023, 4:42 PM
gerritbot added a comment.Sep 29 2023, 4:02 PM

Change 951960 had a related patch set uploaded (by Bking; author: Ebernhardson):

[operations/deployment-charts@master] cirrus streaming updater service

https://gerrit.wikimedia.org/r/951960

gerritbot added a project: Patch-For-Review.Sep 29 2023, 4:02 PM
bking added a parent task: T340548: [EPIC] Deployment of the Search Update Pipeline on Flink / k8s.Oct 3 2023, 1:48 PM
gerritbot added a comment.Oct 6 2023, 7:22 PM

Change 964069 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] wikikube: prepare new cirrus-streaming-updater service

https://gerrit.wikimedia.org/r/964069

gerritbot added a comment.Oct 6 2023, 7:29 PM

Change 964071 had a related patch set uploaded (by Bking; author: Bking):

[operations/deployment-charts@master] cirrus: create new namespace

https://gerrit.wikimedia.org/r/964071

gerritbot added a comment.Oct 6 2023, 7:33 PM

Change 964069 merged by Bking:

[operations/puppet@production] wikikube: prepare new cirrus-streaming-updater service

https://gerrit.wikimedia.org/r/964069

gerritbot added a comment.Oct 6 2023, 7:37 PM

Change 964071 merged by Bking:

[operations/deployment-charts@master] cirrus: create new namespace

https://gerrit.wikimedia.org/r/964071

gerritbot added a comment.Oct 6 2023, 8:06 PM

Change 951960 merged by Bking:

[operations/deployment-charts@master] cirrus streaming updater service

https://gerrit.wikimedia.org/r/951960

Maintenance_bot removed a project: Patch-For-Review.Oct 6 2023, 8:12 PM
Gehel moved this task from Incoming to In Progress on the Discovery-Search (Current work) board.Oct 9 2023, 3:36 PM
Gehel set the point value for this task to 8.
gerritbot added a comment.Oct 9 2023, 4:34 PM

Change 964567 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] admin: Add cirrus-streaming-updater namespace to flink operator

https://gerrit.wikimedia.org/r/964567

gerritbot added a project: Patch-For-Review.Oct 9 2023, 4:34 PM
gerritbot added a comment.Oct 11 2023, 5:28 PM

Change 964567 merged by Bking:

[operations/deployment-charts@master] admin: Add cirrus-streaming-updater namespace to flink operator

https://gerrit.wikimedia.org/r/964567

Maintenance_bot removed a project: Patch-For-Review.Oct 11 2023, 5:29 PM
gerritbot added a comment.Oct 11 2023, 8:24 PM

Change 965248 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] flink-zk: Permit traffic from STAGING_KUBEPODS_NETWORKS

https://gerrit.wikimedia.org/r/965248

gerritbot added a project: Patch-For-Review.Oct 11 2023, 8:24 PM
gerritbot added a comment.Oct 11 2023, 8:26 PM

Change 965248 merged by Bking:

[operations/puppet@production] flink-zk: Permit traffic from STAGING_KUBEPODS_NETWORKS

https://gerrit.wikimedia.org/r/965248

Maintenance_bot removed a project: Patch-For-Review.Oct 11 2023, 8:30 PM
gerritbot added a comment.Oct 11 2023, 8:36 PM

Change 965249 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus-streaming-updater: Correctly define the entry class

https://gerrit.wikimedia.org/r/965249

gerritbot added a project: Patch-For-Review.Oct 11 2023, 8:36 PM
gerritbot added a comment.Oct 11 2023, 8:40 PM

Change 965249 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus-streaming-updater: Correctly define the entry class

https://gerrit.wikimedia.org/r/965249

Maintenance_bot removed a project: Patch-For-Review.Oct 11 2023, 9:10 PM
CodeReviewBot added a project: Patch-For-Review.Oct 11 2023, 9:34 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/34

docker: Enable the s3-presto plugin

CodeReviewBot added a comment.Oct 11 2023, 9:46 PM

ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/34

docker: Enable the s3-presto plugin

gerritbot added a comment.Oct 11 2023, 10:02 PM

Change 965256 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus-streaming-updater: Enable s3 for state storage

https://gerrit.wikimedia.org/r/965256

gerritbot added a comment.Oct 11 2023, 10:09 PM

Change 965256 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus-streaming-updater: Enable s3 for state storage

https://gerrit.wikimedia.org/r/965256

Maintenance_bot removed a project: Patch-For-Review.Oct 11 2023, 10:10 PM
CodeReviewBot added a project: Patch-For-Review.Oct 12 2023, 11:07 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/35

Add config option for event stream http routes

CodeReviewBot added a comment.Oct 16 2023, 8:06 AM

dcausse merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/35

Add config option for event stream http routes

Maintenance_bot removed a project: Patch-For-Review.Oct 16 2023, 8:11 AM
Gehel updated Other Assignee, added: bking.Oct 16 2023, 3:09 PM
bking claimed this task.Oct 16 2023, 3:12 PM
bking updated Other Assignee, removed: bking.
gerritbot added a comment.Oct 16 2023, 4:07 PM

Change 966247 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus-updater: Add routes for event stream to use local proxy for schema access

https://gerrit.wikimedia.org/r/966247

gerritbot added a project: Patch-For-Review.Oct 16 2023, 4:07 PM
gerritbot added a comment.Oct 16 2023, 4:18 PM

Change 966247 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus-updater: Add routes for event stream to use local proxy for schema access

https://gerrit.wikimedia.org/r/966247

Maintenance_bot removed a project: Patch-For-Review.Oct 16 2023, 4:31 PM
gerritbot added a comment.Oct 16 2023, 5:46 PM

Change 966268 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Adjust event stream http route to match updated config

https://gerrit.wikimedia.org/r/966268

gerritbot added a project: Patch-For-Review.Oct 16 2023, 5:46 PM
gerritbot added a comment.Oct 16 2023, 5:53 PM

Change 966268 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Adjust event stream http route to match updated config

https://gerrit.wikimedia.org/r/966268

Maintenance_bot removed a project: Patch-For-Review.Oct 16 2023, 6:10 PM
gerritbot added a comment.Oct 16 2023, 7:08 PM

Change 966283 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: topic-prefix-filter must be plain string prefix

https://gerrit.wikimedia.org/r/966283

gerritbot added a project: Patch-For-Review.Oct 16 2023, 7:08 PM
gerritbot added a comment.Oct 16 2023, 7:11 PM

Change 966283 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: topic-prefix-filter must be plain string prefix

https://gerrit.wikimedia.org/r/966283

gerritbot added a comment.Oct 16 2023, 7:15 PM

Change 966285 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: pipeline.name is a required parameter

https://gerrit.wikimedia.org/r/966285

gerritbot added a comment.Oct 16 2023, 7:19 PM

Change 966285 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: pipeline.name is a required parameter

https://gerrit.wikimedia.org/r/966285

Maintenance_bot removed a project: Patch-For-Review.Oct 16 2023, 7:30 PM
gerritbot added a comment.Oct 16 2023, 10:34 PM

Change 966308 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/puppet@production] kafka-main: Allow connections from wikikube-staging

https://gerrit.wikimedia.org/r/966308

gerritbot added a project: Patch-For-Review.Oct 16 2023, 10:34 PM
gerritbot added a comment.Oct 17 2023, 3:57 PM

Change 966308 abandoned by Ebernhardson:

[operations/puppet@production] kafka-main: Allow connections from wikikube-staging

Reason:

While this looked like the problem, on closer debugging this isn't the case. After getting a shell inside the pod and running a test python script I've verified all kafka-main1*:9093 hosts can be connected to from the staging pod.

https://gerrit.wikimedia.org/r/966308

Maintenance_bot removed a project: Patch-For-Review.Oct 17 2023, 4:10 PM
CodeReviewBot added a comment.Oct 17 2023, 10:07 PM

ebernhardson updated https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/37

Align weighted tags with production

CodeReviewBot added a comment.Oct 18 2023, 10:00 AM

dcausse merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/37

Align weighted tags with production

gerritbot added a comment.Oct 18 2023, 6:32 PM

Change 966912 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Read codfw events in staging

https://gerrit.wikimedia.org/r/966912

gerritbot added a project: Patch-For-Review.Oct 18 2023, 6:33 PM
gerritbot added a comment.Oct 18 2023, 6:35 PM

Change 966912 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Read codfw events in staging

https://gerrit.wikimedia.org/r/966912

CodeReviewBot added a comment.Oct 18 2023, 6:52 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/38

Don't require leading / in event schemas

CodeReviewBot added a comment.Oct 18 2023, 7:04 PM

ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/38

Don't require leading / in event schemas

CodeReviewBot added a comment.Oct 18 2023, 10:54 PM

ebernhardson updated https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/39

Add some debugging info to UpdateEventMerger

CodeReviewBot added a comment.Oct 19 2023, 2:46 PM

dcausse merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/39

Add some debugging info to UpdateEventMerger

gerritbot added a comment.Oct 19 2023, 3:11 PM

Change 967232 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Update container image

https://gerrit.wikimedia.org/r/967232

gerritbot added a comment.Oct 19 2023, 3:24 PM

Change 967232 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Update container image

https://gerrit.wikimedia.org/r/967232

CodeReviewBot added a comment.Oct 19 2023, 10:35 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/41

event merger: Handle null Update objects

CodeReviewBot added a comment.Oct 20 2023, 5:00 PM

ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/41

event merger: Handle null Update objects

gerritbot added a comment.Oct 20 2023, 5:28 PM

Change 967482 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Update container image

https://gerrit.wikimedia.org/r/967482

gerritbot added a comment.Oct 20 2023, 5:30 PM

Change 967482 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Update container image

https://gerrit.wikimedia.org/r/967482

gerritbot added a comment.Oct 20 2023, 6:37 PM

Change 967507 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Ensure all output topics exist

https://gerrit.wikimedia.org/r/967507

gerritbot added a comment.Oct 20 2023, 6:41 PM

Change 967507 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Ensure all output topics exist

https://gerrit.wikimedia.org/r/967507

gerritbot added a comment.Oct 20 2023, 7:28 PM

Change 967520 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Provide elasticsearch routes

https://gerrit.wikimedia.org/r/967520

gerritbot added a comment.Oct 20 2023, 7:33 PM

Change 967520 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Provide elasticsearch routes

https://gerrit.wikimedia.org/r/967520

gerritbot added a comment.Oct 20 2023, 7:41 PM

Change 967523 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] relforge: Allow traffic from staging wikikube

https://gerrit.wikimedia.org/r/967523

gerritbot added a comment.Oct 20 2023, 7:45 PM

Change 967523 merged by Bking:

[operations/puppet@production] relforge: Allow traffic from staging wikikube

https://gerrit.wikimedia.org/r/967523

gerritbot added a comment.Oct 20 2023, 8:02 PM

Change 967526 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/deployment-charts@master] cirrus updater: Disable the all-matching http route in staging

https://gerrit.wikimedia.org/r/967526

gerritbot added a comment.Oct 20 2023, 8:04 PM

Change 967526 merged by jenkins-bot:

[operations/deployment-charts@master] cirrus updater: Disable the all-matching http route in staging

https://gerrit.wikimedia.org/r/967526

CodeReviewBot added a comment.Oct 24 2023, 10:21 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/44

Correct UpdateEvent.hasFields

CodeReviewBot added a comment.Oct 25 2023, 6:06 PM

ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/44

Correct UpdateEvent.hasFields

CodeReviewBot added a comment.Oct 25 2023, 7:06 PM

ebernhardson opened https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/45

Move sink creation into common module

CodeReviewBot added a comment.Oct 25 2023, 7:14 PM

ebernhardson merged https://gitlab.wikimedia.org/repos/search-platform/cirrus-streaming-updater/-/merge_requests/45

Move sink creation into common module

bking updated the task description. (Show Details)Oct 31 2023, 5:59 PM
gerritbot added a comment.Oct 31 2023, 7:57 PM

Change 970435 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):

[operations/deployment-charts@master] cirrus-streaming-updater: bump vers (NPE fix)

https://gerrit.wikimedia.org/r/970435

gerritbot added a comment.Oct 31 2023, 8:02 PM

Change 970435 merged by Ryan Kemper:

[operations/deployment-charts@master] cirrus-streaming-updater: bump vers (NPE fix)

https://gerrit.wikimedia.org/r/970435

bking mentioned this in T350185: Estimate cirrus streaming updater's usage of MWAPI.Nov 8 2023, 8:28 PM
EBernhardson moved this task from In Progress to Needs Reporting on the Discovery-Search (Current work) board.EditedNov 29 2023, 8:01 PM

Updater has been running for 7d now without falling over. Using the compare-clusters.py script from Cirrus the itwiki and frwiki indices in relforge claim to be staying in sync with the production clusters which use the old updater.

That should be enough to consider the test deployment complete and ready for the next phase

Gehel closed subtask T350299: EventBus change events involving redirect changes are sometimes incorrect as Resolved.Dec 1 2023, 9:15 AM
Gehel closed this task as Resolved.Dec 1 2023, 9:20 AM
Gehel closed subtask T350186: Cirrus-streaming-updater test: validate relforge indices are correctly updated as Resolved.Feb 2 2024, 2:31 PM
bking closed subtask T348350: Set requests (not limits) for cirrus-streaming-updater in k8s as Resolved.Mar 1 2024, 3:50 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits