EventStreamCatalog removes 'topic' table option if connector = upsert-kafka
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Ottomata
	Feb 28 2023, 3:51 PM

Description

As an event platform engineer, I want to use upsert-kafka connector with EventStreamCatalog

Why?

upsert-kafka is a specialied Kafka connector. Right now EventStreamCatalog removes the 'topic' option if the connector is not Kafka. It should not do so if the connector is 'upsert-kafka'.

Done is:

It is possible to use upsert-kafka connector with EventStreamCatalog

Details

	Subject	Repo	Branch	Lines +/-
	Allow kafka options for upsert-kafka	wikimedia-event-utilities	master	+23 -1

Customize query in gerrit

Event Timeline

Ottomata created this task.Feb 28 2023, 3:51 PM

Restricted Application added a project: Data-Engineering. · View Herald TranscriptFeb 28 2023, 3:51 PM

Restricted Application added subscribers: Masumrezarock100, Aklapper. · View Herald Transcript

lbowmaker edited projects, added Data-Engineering-Planning; removed Data-Engineering.Mar 1 2023, 5:19 PM

lbowmaker moved this task from Backlog to Event Platform on the Data-Engineering-Planning board.

Ottomata unsubscribed.Mar 1 2023, 5:20 PM

Ottomata moved this task from Backlog to To be Estimated/To be discussed on the Event-Platform board.Mar 6 2023, 2:03 PM

JArguello-WMF updated the task description. (Show Details)Mar 8 2023, 2:21 PM

JArguello-WMF assigned this task to tchin.Mar 8 2023, 3:18 PM

Ottomata removed tchin as the assignee of this task.Mar 8 2023, 3:18 PM

Ottomata updated the task description. (Show Details)

Ottomata added a subscriber: tchin.

Ottomata updated the task description. (Show Details)Mar 8 2023, 3:38 PM

JArguello-WMF edited projects, added Event-Platform (Sprint 10); removed Event-Platform.Mar 13 2023, 3:45 PM

tchin claimed this task.Mar 14 2023, 1:34 AM

Change 898239 had a related patch set uploaded (by TChin; author: TChin):

[wikimedia-event-utilities@master] Allow kafka options for upsert-kafka

https://gerrit.wikimedia.org/r/898239

gerritbot added a project: Patch-For-Review.Mar 14 2023, 2:10 AM

tchin moved this task from Next Up to In Review on the Event-Platform (Sprint 10) board.Mar 14 2023, 2:14 AM

Change 898239 merged by jenkins-bot:

[wikimedia-event-utilities@master] Allow kafka options for upsert-kafka

https://gerrit.wikimedia.org/r/898239

Maintenance_bot removed a project: Patch-For-Review.Mar 14 2023, 3:11 PM

tchin moved this task from In Review to Done on the Event-Platform (Sprint 10) board.Mar 15 2023, 6:04 AM

JArguello-WMF closed this task as Resolved.Mar 31 2023, 2:35 PM

EventStreamCatalog removes 'topic' table option if connector = upsert-kafkaClosed, ResolvedPublicActions