Page MenuHomePhabricator
Create Task
Maniphest T325305

Deploy mediawiki-event-enrichment flink app to DSE k8s
Closed, ResolvedPublic
Actions

Description

User Story
As a platform engineer I need to deploy the mediawiki-event-enrichment flink app to DSE k8s to practice running it before we are ready and able to deploy to wikikube.
Done is:
  • Service is deployed to DSE k8s and
  • increase to group 1 wikis

Details

Other Assignee
gmodena
ProjectBranchLines +/-Subject
operations/mediawiki-configmaster+10 -0Enable mediawiki.page_change on group1 wikis
operations/deployment-chartsmaster+2 -2mw-page-content-change-enrichment - lower mem usage to match k8s limits
operations/deployment-chartsmaster+8 -0mw--page-content-change-enrichment - increase memory in dse k8s
operations/puppetproduction+2 -0Allow access to kafka jumbo and test from DSE k8s
operations/deployment-chartsmaster+39 -28mw-page-content-change-enrichment - v1.0.5
operations/deployment-chartsmaster+29 -3mw-page-content-change-enrichment - Disable kafka egress
operations/deployment-chartsmaster+1 -1mediawiki-page-content-change-enrichment - bump image version to v1.0.3
operations/deployment-chartsmaster+48 -30Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfile
Customize query in gerrit
ReferenceSource BranchDest BranchAuthorTitle
repos/data-engineering/mediawiki-event-enrichment!10T325305-rc1-stream-updatemaingmodenarc1 stream update
Customize query in GitLab

Related Objects
Search...

Event Timeline

lbowmaker created this task.Dec 15 2022, 3:54 PM
• EChetty edited projects, added Data-Engineering-Planning; removed Data-Engineering.Jan 6 2023, 11:00 AM
• EChetty moved this task from Backlog to Event Platform on the Data-Engineering-Planning board.Jan 6 2023, 11:23 AM
lbowmaker moved this task from Backlog to Sprint 08 on the Event-Platform Value Stream board.Jan 27 2023, 3:25 PM
lbowmaker edited projects, added Event-Platform Value Stream (Sprint 08); removed Event-Platform Value Stream.
Ottomata renamed this task from Deploy to DSE k8s to Deploy mediawiki-event-enrichment flink app to DSE k8s.Jan 30 2023, 2:07 PM
Ottomata updated the task description. (Show Details)
Ottomata moved this task from Next Up to In Progress on the Event-Platform Value Stream (Sprint 08) board.Jan 30 2023, 2:19 PM
JArguello-WMF assigned this task to Ottomata.Jan 30 2023, 3:27 PM
JArguello-WMF updated Other Assignee, added: gmodena.
lbowmaker updated the task description. (Show Details)Jan 30 2023, 3:37 PM
gerritbot added a comment.Jan 30 2023, 5:25 PM

Change 884972 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] [WIP] Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfile

https://gerrit.wikimedia.org/r/884972

gerritbot added a project: Patch-For-Review.Jan 30 2023, 5:25 PM
gerritbot added a comment.Jan 30 2023, 8:30 PM

Change 884972 merged by Ottomata:

[operations/deployment-charts@master] Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfile

https://gerrit.wikimedia.org/r/884972

gerritbot added a comment.Jan 30 2023, 8:45 PM

Change 885032 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mediawiki-page-content-change-enrichment - bump image version to v1.0.3

https://gerrit.wikimedia.org/r/885032

gerritbot added a comment.Jan 30 2023, 8:49 PM

Change 885032 merged by Ottomata:

[operations/deployment-charts@master] mediawiki-page-content-change-enrichment - bump image version to v1.0.3

https://gerrit.wikimedia.org/r/885032

gerritbot added a comment.Jan 30 2023, 9:10 PM

Change 885035 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - Disable kafka egress

https://gerrit.wikimedia.org/r/885035

gerritbot added a comment.Jan 30 2023, 9:17 PM

Change 885035 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - Disable kafka egress

https://gerrit.wikimedia.org/r/885035

Maintenance_bot removed a project: Patch-For-Review.Jan 30 2023, 9:31 PM
gerritbot added a comment.Jan 31 2023, 2:35 PM

Change 885357 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - v1.0.5

https://gerrit.wikimedia.org/r/885357

gerritbot added a project: Patch-For-Review.Jan 31 2023, 2:35 PM
gerritbot added a comment.Jan 31 2023, 2:42 PM

Change 885357 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - v1.0.5

https://gerrit.wikimedia.org/r/885357

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 3:31 PM
Ottomata mentioned this in T328447: Add dse k8s networks to puppet network constants.Jan 31 2023, 3:35 PM
gerritbot added a comment.Jan 31 2023, 3:42 PM

Change 885367 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] Allow access to kafka jumbo and test from DSE k8s

https://gerrit.wikimedia.org/r/885367

gerritbot added a project: Patch-For-Review.Jan 31 2023, 3:42 PM
gerritbot added a comment.Jan 31 2023, 3:56 PM

Change 885367 merged by Ottomata:

[operations/puppet@production] Allow access to kafka jumbo and test from DSE k8s

https://gerrit.wikimedia.org/r/885367

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 4:30 PM
gerritbot added a comment.Jan 31 2023, 4:41 PM

Change 885382 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw--page-content-change-enrichment - increase memory in dse k8s

https://gerrit.wikimedia.org/r/885382

gerritbot added a project: Patch-For-Review.Jan 31 2023, 4:41 PM
gerritbot added a comment.Jan 31 2023, 4:46 PM

Change 885382 merged by Ottomata:

[operations/deployment-charts@master] mw--page-content-change-enrichment - increase memory in dse k8s

https://gerrit.wikimedia.org/r/885382

gerritbot added a comment.Jan 31 2023, 4:50 PM

Change 885384 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - lower mem usage to match k8s limits

https://gerrit.wikimedia.org/r/885384

gerritbot added a comment.Jan 31 2023, 4:51 PM

Change 885384 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - lower mem usage to match k8s limits

https://gerrit.wikimedia.org/r/885384

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 5:31 PM
JArguello-WMF updated the task description. (Show Details)Feb 6 2023, 2:16 PM
JArguello-WMF added a subscriber: JArguello-WMF.

Monitoring needs a task of its own @Ottomata can you help me with that?

Ottomata added a comment.Feb 6 2023, 2:59 PM

Done: T328925: Flink Enrichment monitoring

gerritbot added a comment.Feb 7 2023, 7:00 PM

gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/10

Draft: rc1 stream update

gerritbot added a project: Patch-For-Review.Feb 7 2023, 7:00 PM
gerritbot added a comment.Feb 8 2023, 2:37 PM

gmodena merged https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/10

rc1 stream update

Maintenance_bot removed a project: Patch-For-Review.Feb 8 2023, 3:31 PM
Ottomata updated the task description. (Show Details)Feb 13 2023, 2:13 PM
gerritbot added a comment.Feb 13 2023, 4:37 PM

Change 888752 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] Enable mediawiki.page_change on group1 wikis

https://gerrit.wikimedia.org/r/888752

gerritbot added a project: Patch-For-Review.Feb 13 2023, 4:37 PM
Ottomata moved this task from In Progress to Ready to Deploy on the Event-Platform Value Stream (Sprint 08) board.Feb 13 2023, 6:16 PM
gerritbot added a comment.Feb 13 2023, 8:37 PM

Change 888752 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable mediawiki.page_change on group1 wikis

https://gerrit.wikimedia.org/r/888752

Maintenance_bot removed a project: Patch-For-Review.Feb 13 2023, 9:10 PM
Ottomata updated the task description. (Show Details)Feb 13 2023, 9:39 PM
Ottomata updated the task description. (Show Details)
JArguello-WMF moved this task from Ready to Deploy to Done on the Event-Platform Value Stream (Sprint 08) board.Feb 14 2023, 2:10 PM
lbowmaker closed this task as Resolved.Feb 17 2023, 2:48 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL