Page MenuHomePhabricator
Create Task
Maniphest T332913

[dse-k8s] Provide common spark config for spark jobs
Closed, ResolvedPublic
Actions

Description

Spark jobs required to have spark config (spark-defaults.conf) available to be have default settings applied

Related Objects
Search...

Event Timeline

• nfraison created this task.Mar 23 2023, 4:12 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 23 2023, 4:12 PM
BTullis added a project: Data-Platform-SRE.Jun 9 2023, 11:56 AM
JArguello-WMF removed a project: Shared-Data-Infrastructure.Jun 29 2023, 1:44 PM
BTullis renamed this task from Provide common spark config for spark jobs to [dse-k8s] Provide common spark config for spark jobs.Jul 3 2023, 11:54 AM
BTullis triaged this task as Low priority.
BTullis added a parent task: T318712: Enable spark jobs on the dse-k8s cluster via the spark-operator.Jul 3 2023, 12:01 PM
Gehel moved this task from Incoming to Misc on the Data-Platform-SRE board.Dec 7 2023, 2:15 PM
BTullis added a parent task: T406833: Create a helm chart that manages the resources required for running useful spark jobs on kubernetes.Oct 9 2025, 10:52 AM
BTullis removed a parent task: T318712: Enable spark jobs on the dse-k8s cluster via the spark-operator.Oct 10 2025, 9:36 AM
BTullis closed this task as Resolved.Dec 4 2025, 2:47 PM
BTullis claimed this task.
BTullis edited projects, added Data-Platform-SRE (2025.11.07 - 2025.11.28); removed Data-Platform-SRE.
BTullis subscribed.

Resolving this, as it is now achieved through the spark-support chart: T406833

BTullis moved this task from Backlog - project to Done on the Data-Platform-SRE (2025.11.07 - 2025.11.28) board.Dec 4 2025, 2:47 PM
Gehel moved this task from Done to Reported on the Data-Platform-SRE (2025.11.07 - 2025.11.28) board.Dec 5 2025, 10:01 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits