Maniphest T335408

Upgrade Flink Image to 1.17
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Ottomata
	Apr 26 2023, 2:03 PM

Tags

Referenced Files

None

Subscribers

Description

pyflink 1.16.1 has a bug where duplicate operators are created. This is fixed in 1.17.

Along the way, we will also update to:

debian bullsye
python 3.9

Details

	Subject	Repo	Branch	Lines +/-
	page_content_change- bump image to v0.14.0	operations/deployment-charts	master	+1 -1
	flink - upgrade to flink 1.17.0, python 3.9, Debian Bullsye	operations/docker-images/production-images	master	+14 -24

Customize query in gerrit

	Title	Reference	Author	Source Branch	Dest Branch
	Updates for python 3.9 and pyflink 1.17	repos/data-engineering/eventutilities-python!47	otto	flink-1.17.0	main
	Upgrade to flink 1.17.0-wmf0	repos/data-engineering/mediawiki-event-enrichment!50	otto	flink-1.17.0	main
	Upgrade to flink 1.17 and python 3.9	repos/data-engineering/eventutilities-python!45	otto	flink-1.17.0	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Ottomata	T335408 Upgrade Flink Image to 1.17
		Resolved		Ottomata	T335982 Upgrade eventutiltilies-flink Java lib to Flink 1.17

Event Timeline

Ottomata created this task.Apr 26 2023, 2:03 PM

Restricted Application added a project: Data-Engineering. · View Herald TranscriptApr 26 2023, 2:03 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Ottomata moved this task from Backlog to Sprint 12 on the Event-Platform board.Apr 26 2023, 2:03 PM

Ottomata edited projects, added Event-Platform (Sprint 12); removed Event-Platform.

Ottomata moved this task from Next Up to In progress on the Event-Platform (Sprint 12) board.Apr 28 2023, 6:14 PM

Change 914358 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/docker-images/production-images@master] flink - upgrade to flink 1.17.0, python 3.9, Debian Bullsye

https://gerrit.wikimedia.org/r/914358

gerritbot added a project: Patch-For-Review.May 2 2023, 3:33 PM

otto opened https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/45

Draft: Upgrade to flink 1.17 and python 3.9

Change 914358 merged by Ottomata:

[operations/docker-images/production-images@master] flink - upgrade to flink 1.17.0, python 3.9, Debian Bullsye

https://gerrit.wikimedia.org/r/914358

otto merged https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/45

Upgrade to flink 1.17 and python 3.9

Maintenance_bot removed a project: Patch-For-Review.May 2 2023, 6:10 PM

otto opened https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/50

Upgrade to flink 1.17.0-wmf0

gerritbot added a project: Patch-For-Review.May 2 2023, 6:38 PM

otto merged https://gitlab.wikimedia.org/repos/data-engineering/mediawiki-event-enrichment/-/merge_requests/50

Upgrade to flink 1.17.0-wmf0

Maintenance_bot removed a project: Patch-For-Review.May 2 2023, 7:10 PM

Change 914389 had a related patch set uploaded (by Ottomata; author: Ottomata):

[operations/deployment-charts@master] page_content_change- bump image to v0.14.0

https://gerrit.wikimedia.org/r/914389

gerritbot added a project: Patch-For-Review.May 2 2023, 7:19 PM

Change 914389 merged by Ottomata:

[operations/deployment-charts@master] page_content_change- bump image to v0.14.0

https://gerrit.wikimedia.org/r/914389

Maintenance_bot removed a project: Patch-For-Review.May 2 2023, 7:29 PM

otto opened https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/47

Updates for python 3.9 and pyflink 1.17

gerritbot added a project: Patch-For-Review.May 2 2023, 8:25 PM

Ottomata moved this task from In progress to In Review on the Event-Platform (Sprint 12) board.May 2 2023, 8:41 PM

tchin merged https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-python/-/merge_requests/47

Updates for python 3.9 and pyflink 1.17

Maintenance_bot removed a project: Patch-For-Review.May 2 2023, 9:10 PM

JArguello-WMF moved this task from In Review to Done on the Event-Platform (Sprint 12) board.May 4 2023, 1:10 PM

Ottomata mentioned this in T335982: Upgrade eventutiltilies-flink Java lib to Flink 1.17.May 4 2023, 4:43 PM

JArguello-WMF moved this task from Incoming (new tickets) to Event Platform Backlog on the Data-Engineering board.Jun 29 2023, 11:33 PM

Ottomata closed this task as Resolved.Dec 19 2023, 5:37 PM

Ottomata closed subtask T335982: Upgrade eventutiltilies-flink Java lib to Flink 1.17 as Resolved.