Maniphest T324017

Set up Spark SQL Server
Open, HighPublic
Actions

Assigned To

None

Authored By

	• EChetty
	Nov 29 2022, 1:37 PM

Tags

Referenced Files

None

Subscribers

Description

Spark thrift-server is supposedly equivalent to hive-server2, allowing to run spark SQL queries on the cluster. This server would be (a lot) faster than hive, and therefore could possibly be used with Superset, in an idea of possibly replacing presto

Goal: Set up a Spark SQL Server to test performance.

Event Timeline

• EChetty created this task.Nov 29 2022, 1:37 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 29 2022, 1:37 PM

• EChetty updated the task description. (Show Details)Nov 29 2022, 1:40 PM

• EChetty moved this task from To be discussed to EQ2 Kanban (Sprints 04-07) on the Shared-Data-Infrastructure board.Nov 29 2022, 2:40 PM

• EChetty edited projects, added Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-07)); removed Shared-Data-Infrastructure.

• EChetty triaged this task as High priority.Nov 29 2022, 2:47 PM

• EChetty updated the task description. (Show Details)

• EChetty moved this task from EQ2 Kanban (Sprints 04-07) to Estimated/Discussed on the Shared-Data-Infrastructure board.Jan 23 2023, 1:32 PM

• EChetty edited projects, added Shared-Data-Infrastructure; removed Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-07)).