We need a gridengine replacement to schedule and manage arbitrary user applications in a flexible, user friendly way.
Potential candidates with substantial adoption, development community health, and feature-completeness are at the moment (IMO):
# Mesos+Marathon+Chronos
# Kubernetes
The chosen product should at least:
# Allow arbitrary processes to be executed on an arbitrary number of machines with specific resource requirements
# Respond to node crashes by rescheduling user processes on a different machine
# Cron-like functionality to run user processes at specific times
# Configurable process isolation (memory, cpu and networking)
# User ACLs that are strongly isolated (prevent one user from messing with other users' jobs)
Bonuses:
# Allows running one off tasks interactively