Page MenuHomePhabricator

Flink EventStreamCatalog should not prevent creation of VIEWs
Closed, ResolvedPublic

Description

Our EventStreamCatalog validates config options when creating tables, and it does not allow creation of tables without specifying options like 'event-json.event-stream-name'.

However, these options also seem to be validated when creating views on top of existing tables.

Example:

CREATE VIEW my_view AS (
    SELECT wiki_id, page.page_id, page.page_title
    FROM `rc1.mediawiki.page_change`
);

Results in

[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.table.catalog.exceptions.CatalogException: Table requires 'event-stream-name' option
  • Creating views in EventStreamCatalogs should not require all catalog options.

Event Timeline

Change 898240 had a related patch set uploaded (by TChin; author: TChin):

[wikimedia-event-utilities@master] Support creating views in event catalog

https://gerrit.wikimedia.org/r/898240

Change 898240 merged by jenkins-bot:

[wikimedia-event-utilities@master] Support creating views in event catalog

https://gerrit.wikimedia.org/r/898240