Page MenuHomePhabricator

Orchestration of end-to-end machine learning workloads
Open, Needs TriagePublic

Description

Event Timeline

  • first wip ML pipeline that uses spark, bash and skein operators in single dag

update

  • skein based operator that deploys a key/value store on demand using tikv

@fkaelin is this task still relevant? If yes and you want to work on it in the coming 6 months, leave it here. Otherwise, please move it to Research-Freezer board. thanks!

Moving to freezer as TrainWing is on pause and there is no dedicated ML training infrastructure or orchestration tooling available.

@fkaelin: Per emails from Sep18 and Oct20 and https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup , I am resetting the assignee of this task because there has not been progress lately (please correct me if I am wrong!). Resetting the assignee avoids the impression that somebody is already working on this task. It also allows others to potentially work towards fixing this task. Please claim this task again when you plan to work on it (via Add Action...Assign / Claim in the dropdown menu) - it would be welcome. Thanks for your understanding!