On-Device ML for LLMs: Post-Training Optimization Techniques with T5 and Beyond
29 min

On-Device ML for LLMs: Post-Training Optimization Techniques with T5 and Beyond

MLOps World - MLOps World & Generative AI World 2024
Sri Raghu Malireddi
on-device-ml llms t5 model-optimization quantization pruning layer-fusion inference-optimization latency-reduction edge-devices mlops grammarly