Maniphest T288254

Explore Containerization Solutions for DE Applications
Closed, ResolvedPublicSpike
Actions

Description

Explore containerization of data applications such as Airflow and Jupyter notebooks to support isolated and scalable workloads.

Related Objects

Mentioned Here: T296543: Tooling for Deploying Conda Environments

Event Timeline

odimitrijevic created this task.Aug 5 2021, 3:41 PM

Restricted Application changed the subtype of this task from "Task" to "Spike". · View Herald TranscriptAug 5 2021, 3:41 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

odimitrijevic added a project: Data-Engineering-Kanban.Aug 12 2021, 5:26 PM

odimitrijevic moved this task from Next Up to Q2 Epics on the Data-Engineering-Kanban board.

odimitrijevic removed a project: Data-Engineering-Kanban.Oct 25 2021, 3:30 PM

mforns added a project: Data Pipelines.Nov 5 2021, 4:48 PM

mforns removed a project: Spike.Nov 5 2021, 9:12 PM

mforns added a project: Spike.

mforns updated the task description. (Show Details)

Just reopened https://phabricator.wikimedia.org/T296543#7538145, perhaps we should merge these together.

• EChetty moved this task from Backlog to Next Up (revisit every 2 sprints) on the Data Pipelines board.Feb 1 2022, 5:18 PM

• EChetty moved this task from Next Up (revisit every 2 sprints) to Epics on the Data Pipelines board.Aug 15 2022, 9:04 AM

JArguello-WMF moved this task from Tag with Icebox to Event Platform Backlog on the Data-Engineering board.Jun 29 2023, 11:21 PM

JArguello-WMF added a project: Data Engineering and Event Platform Team.Jun 30 2023, 5:31 PM

JArguello-WMF moved this task from Data Eng Backlog to Parent Tasks/Epics on the Data Engineering and Event Platform Team board.Jun 30 2023, 5:38 PM

BTullis added a project: Data-Platform-SRE.Jul 14 2023, 11:48 PM

The work related to this has been done as part of standing up the DSE K8s cluster. I will go ahead and close the ticket.

odimitrijevic closed this task as Resolved.Aug 16 2023, 4:24 PM

odimitrijevic claimed this task.

Gehel edited projects, added Data-Platform-SRE (2023.12.01 - 2023.12.31); removed Data-Platform-SRE.Jan 10 2025, 4:56 PM

Gehel moved this task from Backlog to Done on the Data-Platform-SRE (2023.12.01 - 2023.12.31) board.