From https://spark.apache.org/security.html it seems that it would be good to upgrade to Spark 2.3.2 to solve a CVE for PySpark. It doesn't seem a major problem for us but if possible having a up to date version would be good.
Description
Description
Event Timeline
elukey created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 31 2019, 11:00 PM2019-01-31 23:00:19 (UTC+0)
• fdans renamed this task from Upgrade to Spark 2.3.2 to Upgrade to Spark 2.4.0.Feb 18 2019, 4:57 PM2019-02-18 16:57:33 (UTC+0)
Ottomata closed this task as a duplicate of T222253: Upgrade Spark to 2.4.x.May 17 2019, 4:59 PM2019-05-17 16:59:03 (UTC+0)