Low-latency Model Inference in Finance: A Close Look at Seldon V2
31 min

Low-latency Model Inference in Finance: A Close Look at Seldon V2

MLOps World - MLOps World & Generative AI World 2024
Vincent David Michael Meredith
model-inference low-latency service-oriented-architecture dag seldon machine-learning fintech kubernetes custom-resource-definitions mlops api-gateway grpc kafka
Creating our own Private OpenAI API
29 min

Creating our own Private OpenAI API

MLOps World - MLOps World & Generative AI World 2024
Meryem Arik Hannes Hapke
large-language-models llms private-api openai-api self-hosting mlops generative-ai inference-optimization quantization gpu-utilization api-gateway kubernetes
SIG-Multicluster Intro and Deep Dive
27 min

SIG-Multicluster Intro and Deep Dive

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Jeremy Olmsted-Thompson Laura Lorenz Paul Morie Stephen Kitt
kubernetes multi-cluster sig-multicluster cluster-set about-api mcs-api multi-cluster-services api-gateway cloud-native networking conformance-testing container-orchestration
Exiting Ingress 201: A Primer on Extension Mechanisms in Gateway API
33 min

Exiting Ingress 201: A Primer on Extension Mechanisms in Gateway API

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Sunjay Bhatia Daneyon Hansen
api-gateway kubernetes ingress extension-mechanisms policy-attachment traffic-routing cloud-native api-design meta-resources
Contour: The Past, Present, and Future of the Project and Community
30 min

Contour: The Past, Present, and Future of the Project and Community

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Steve Kriss Nigel Brown
kubernetes ingress-controller envoy-proxy api-gateway cncf networking cloud-native service-mesh load-balancing http-proxy telemetry
Connecting and Securing Services for Hybrid and Multi Cloud Kubernetes
39 min

Connecting and Securing Services for Hybrid and Multi Cloud Kubernetes

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Rania Mohamed Piotr Szczesniak Roland Kool Ricardo Rocha Christian Huenning
kubernetes hybrid-cloud multi-cloud cloud-native service-mesh connectivity security networking api-gateway container-orchestration observability
Two Houses, Both Alike in Dignity: Gateway API and MCS API
35 min

Two Houses, Both Alike in Dignity: Gateway API and MCS API

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Laura Lorenz Rob Scott Stephen Kitt Mike Morris
kubernetes api-gateway mcs-api multi-cluster service-discovery service-mesh traffic-management crd api-design networking cloud-native gamma-initiative
Autoscaling Elastic Kubernetes Infrastructure for Stateful Applications Using Proxyless gRPC and Istio
31 min

Autoscaling Elastic Kubernetes Infrastructure for Stateful Applications Using Proxyless gRPC and Istio

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Sanjay Pujare Costin Manolache
kubernetes autoscaling stateful-applications grpc proxyless-grpc istio service-mesh load-balancing session-affinity api-gateway gke
Story of Our Transition to a Custom Kubernetes Operator for an API Gateway
30 min

Story of Our Transition to a Custom Kubernetes Operator for an API Gateway

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Vincent Behar
kubernetes operator api-gateway automation openapi kong kubebuilder controller-runtime ci-cd cloud-native platform-engineering devops
Beyond Gateway API: Building a Cloud Agnostic Gateway Controller for Self-Service Network Configuration
35 min

Beyond Gateway API: Building a Cloud Agnostic Gateway Controller for Self-Service Network Configuration

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Michael Larsen Martin Villumsen
api-gateway kubernetes cloud-agnostic self-service network-configuration gitops crossplane istio crds templating
Overview and State of Linkerd
34 min

Overview and State of Linkerd

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Matei David
service-mesh linkerd kubernetes cloud-native observability reliability security rust api-gateway circuit-breaking traffic-routing mtls
Highly Available Routing with Multi Cluster Gateways
35 min

Highly Available Routing with Multi Cluster Gateways

KubeCon + CloudNativeCon - KubeCon + CloudNativeCon Europe 2023
Rob Scott Liwen Wu
kubernetes api-gateway multi-cluster-services service-mesh networking cloud-native gke aws-vpc-lattice routing high-availability container-networking