Scheduling Framework: Batch Extensions with Apache YuniKorn
May 01, 2023
40 min
Free
kubernetes
apache-yunikorn
scheduling
batch-processing
data-processing
gang-scheduling
quota-management
hpc
cloud-computing
distributed-systems
Description
This talk explores how Apache YuniKorn extends Kubernetes scheduling capabilities to better handle batch and data processing workloads. It covers features like workload queuing, gang scheduling, and flexible quota management, addressing the limitations of the default Kubernetes scheduler for these types of jobs. The presentation highlights YuniKorn's hierarchical queue structure and its plugin architecture for enhanced customization.