pmady/keda-gpu-scaler
A KEDA External Scaler that enables Kubernetes to autoscale GPU workloads by directly using NVIDIA NVML metrics, supporting scale-to-zero for AI inference servers like vLLM and Triton.
Awesome Infra for AI › AI Deployment on Kubernetes