WG Batch: What's New and What Is Next?
May 01, 2023
41 min
Free
kubernetes
batch-workloads
job-api
job-queueing
kueue
hpc
ai-ml
data-analytics
cicd
specialized-hardware
topology-aware-scheduling
nrt-api
Description
This talk provides an update on the Working Group (WG) Batch for Kubernetes, covering recent improvements and future directions for supporting batch workloads like HPC, AI/ML, and data analytics. Speakers discuss enhancements to the Job API, including scale, failure policies, and Job Queuing with Kueue. They also cover developments in hardware resource management and topology-aware scheduling, detailing how these features improve resource utilization and scheduling decisions in complex environments.