Page MenuHomePhabricator
Create Task
Maniphest T325305

Deploy mediawiki-event-enrichment flink app to DSE k8s
Closed, ResolvedPublic
Actions

Description

User Story
As a platform engineer I need to deploy the mediawiki-event-enrichment flink app to DSE k8s to practice running it before we are ready and able to deploy to wikikube.
Done is:
  • Service is deployed to DSE k8s and
  • increase to group 1 wikis

Details

Other Assignee
gmodena
Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Enable mediawiki.page_change on group1 wikisoperations/mediawiki-configmaster+10 -0
mw-page-content-change-enrichment - lower mem usage to match k8s limitsoperations/deployment-chartsmaster+2 -2
mw--page-content-change-enrichment - increase memory in dse k8soperations/deployment-chartsmaster+8 -0
Allow access to kafka jumbo and test from DSE k8soperations/puppetproduction+2 -0
mw-page-content-change-enrichment - v1.0.5operations/deployment-chartsmaster+39 -28
mw-page-content-change-enrichment - Disable kafka egressoperations/deployment-chartsmaster+29 -3
mediawiki-page-content-change-enrichment - bump image version to v1.0.3operations/deployment-chartsmaster+1 -1
Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfileoperations/deployment-chartsmaster+48 -30
Customize query in gerrit

Related Objects
Search...

Event Timeline

• lbowmaker created this task.Dec 15 2022, 3:54 PM
• EChetty edited projects, added Data-Engineering-Planning; removed Data-Engineering.Jan 6 2023, 11:00 AM
• EChetty moved this task from Backlog to Event Platform on the Data-Engineering-Planning board.Jan 6 2023, 11:23 AM
• lbowmaker moved this task from Backlog to Sprint 08 on the Event-Platform board.Jan 27 2023, 3:25 PM
• lbowmaker edited projects, added Event-Platform (Sprint 08); removed Event-Platform.
Ottomata renamed this task from Deploy to DSE k8s to Deploy mediawiki-event-enrichment flink app to DSE k8s.Jan 30 2023, 2:07 PM
Ottomata updated the task description. (Show Details)
Ottomata moved this task from Next Up to In Progress on the Event-Platform (Sprint 08) board.Jan 30 2023, 2:19 PM
JArguello-WMF assigned this task to Ottomata.Jan 30 2023, 3:27 PM
JArguello-WMF updated Other Assignee, added: gmodena.
• lbowmaker updated the task description. (Show Details)Jan 30 2023, 3:37 PM
gerritbot added a comment.Jan 30 2023, 5:25 PM

Change 884972 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] [WIP] Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfile

https://gerrit.wikimedia.org/r/884972

gerritbot added a project: Patch-For-Review.Jan 30 2023, 5:25 PM
gerritbot added a comment.Jan 30 2023, 8:30 PM

Change 884972 merged by Ottomata:

[operations/deployment-charts@master] Add dse-k8s-services/mediawiki-page-content-change-enrichment helmfile

https://gerrit.wikimedia.org/r/884972

gerritbot added a comment.Jan 30 2023, 8:45 PM

Change 885032 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mediawiki-page-content-change-enrichment - bump image version to v1.0.3

https://gerrit.wikimedia.org/r/885032

gerritbot added a comment.Jan 30 2023, 8:49 PM

Change 885032 merged by Ottomata:

[operations/deployment-charts@master] mediawiki-page-content-change-enrichment - bump image version to v1.0.3

https://gerrit.wikimedia.org/r/885032

gerritbot added a comment.Jan 30 2023, 9:10 PM

Change 885035 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - Disable kafka egress

https://gerrit.wikimedia.org/r/885035

gerritbot added a comment.Jan 30 2023, 9:17 PM

Change 885035 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - Disable kafka egress

https://gerrit.wikimedia.org/r/885035

Maintenance_bot removed a project: Patch-For-Review.Jan 30 2023, 9:31 PM
gerritbot added a comment.Jan 31 2023, 2:35 PM

Change 885357 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - v1.0.5

https://gerrit.wikimedia.org/r/885357

gerritbot added a project: Patch-For-Review.Jan 31 2023, 2:35 PM
gerritbot added a comment.Jan 31 2023, 2:42 PM

Change 885357 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - v1.0.5

https://gerrit.wikimedia.org/r/885357

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 3:31 PM
Ottomata mentioned this in T328447: Add dse k8s networks to puppet network constants.Jan 31 2023, 3:35 PM
gerritbot added a comment.Jan 31 2023, 3:42 PM

Change 885367 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/puppet@production] Allow access to kafka jumbo and test from DSE k8s

https://gerrit.wikimedia.org/r/885367

gerritbot added a project: Patch-For-Review.Jan 31 2023, 3:42 PM
gerritbot added a comment.Jan 31 2023, 3:56 PM

Change 885367 merged by Ottomata:

[operations/puppet@production] Allow access to kafka jumbo and test from DSE k8s

https://gerrit.wikimedia.org/r/885367

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 4:30 PM
gerritbot added a comment.Jan 31 2023, 4:41 PM

Change 885382 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw--page-content-change-enrichment - increase memory in dse k8s

https://gerrit.wikimedia.org/r/885382

gerritbot added a project: Patch-For-Review.Jan 31 2023, 4:41 PM
gerritbot added a comment.Jan 31 2023, 4:46 PM

Change 885382 merged by Ottomata:

[operations/deployment-charts@master] mw--page-content-change-enrichment - increase memory in dse k8s

https://gerrit.wikimedia.org/r/885382

gerritbot added a comment.Jan 31 2023, 4:50 PM

Change 885384 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] mw-page-content-change-enrichment - lower mem usage to match k8s limits

https://gerrit.wikimedia.org/r/885384

gerritbot added a comment.Jan 31 2023, 4:51 PM

Change 885384 merged by Ottomata:

[operations/deployment-charts@master] mw-page-content-change-enrichment - lower mem usage to match k8s limits

https://gerrit.wikimedia.org/r/885384

Maintenance_bot removed a project: Patch-For-Review.Jan 31 2023, 5:31 PM
JArguello-WMF updated the task description. (Show Details)Feb 6 2023, 2:16 PM
JArguello-WMF subscribed.

Monitoring needs a task of its own @Ottomata can you help me with that?

Ottomata added a comment.Feb 6 2023, 2:59 PM

Done: T328925: Flink App Deployment monitoring

gerritbot added a comment.Feb 7 2023, 7:00 PM

gmodena opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/10

Draft: rc1 stream update

gerritbot added a project: Patch-For-Review.Feb 7 2023, 7:00 PM
gerritbot added a comment.Feb 8 2023, 2:37 PM

gmodena merged https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/10

rc1 stream update

Maintenance_bot removed a project: Patch-For-Review.Feb 8 2023, 3:31 PM
Ottomata updated the task description. (Show Details)Feb 13 2023, 2:13 PM
gerritbot added a comment.Feb 13 2023, 4:37 PM

Change 888752 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/mediawiki-config@master] Enable mediawiki.page_change on group1 wikis

https://gerrit.wikimedia.org/r/888752

gerritbot added a project: Patch-For-Review.Feb 13 2023, 4:37 PM
Ottomata moved this task from In Progress to Ready to Deploy on the Event-Platform (Sprint 08) board.Feb 13 2023, 6:16 PM
gerritbot added a comment.Feb 13 2023, 8:37 PM

Change 888752 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable mediawiki.page_change on group1 wikis

https://gerrit.wikimedia.org/r/888752

Maintenance_bot removed a project: Patch-For-Review.Feb 13 2023, 9:10 PM
Ottomata updated the task description. (Show Details)Feb 13 2023, 9:39 PM
Ottomata updated the task description. (Show Details)
JArguello-WMF moved this task from Ready to Deploy to Done on the Event-Platform (Sprint 08) board.Feb 14 2023, 2:10 PM
• lbowmaker closed this task as Resolved.Feb 17 2023, 2:48 PM
JArguello-WMF closed subtask T328925: Flink App Deployment monitoring as Resolved.Jun 5 2023, 11:31 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits