Upgrade the Flink version used by the Search Update Pipeline to fix bulk request size estimation issue
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	Gehel
	Jan 16 2024, 3:13 PM

Description

T353430 contains the overall description and a workaround that is currently deployed. Once the upstream fix is released, we need to upgrade our Flink version and remove our workaround.

AC:

Flink upgraded to a version that contains FLINK-33857
local workaround removed

Related Objects

Mentioned In: T353430: The elasticsearch client does not properly estimate the size of the bulk requests
Mentioned Here: T353430: The elasticsearch client does not properly estimate the size of the bulk requests

Event Timeline

Gehel created this task.Jan 16 2024, 3:13 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 16 2024, 3:13 PM

Gehel triaged this task as High priority.Jan 16 2024, 3:14 PM

Gehel mentioned this in T353430: The elasticsearch client does not properly estimate the size of the bulk requests.

Gehel moved this task from needs triage to ML & Data Pipeline on the Discovery-Search board.

we now use a custom elasticsearch sink, I doubt we'll want to go back to the one provided by flink

Gehel edited projects, added Discovery-Search (2025.05.02 - 2025.05.23); removed Discovery-Search.May 16 2025, 12:20 PM

Gehel moved this task from Incoming to Reported on the Discovery-Search (2025.05.02 - 2025.05.23) board.

Upgrade the Flink version used by the Search Update Pipeline to fix bulk request size estimation issueClosed, DeclinedPublicActions

Description

Related Objects

Event Timeline

Upgrade the Flink version used by the Search Update Pipeline to fix bulk request size estimation issue
Closed, DeclinedPublic
Actions