Scheduling Framework: Batch Extensions with Apache YuniKorn

May 01, 2023 40 min Free

Description

This talk explores how Apache YuniKorn extends Kubernetes scheduling capabilities to better handle batch and data processing workloads. It covers features like workload queuing, gang scheduling, and flexible quota management, addressing the limitations of the default Kubernetes scheduler for these types of jobs. The presentation highlights YuniKorn's hierarchical queue structure and its plugin architecture for enhanced customization.