NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog
Science, Technology & Innovation · Oct 13, 2026
The GPU Fractioning Operator exposes CUDA 13.4-native GPU memory fractioning in Kubernetes, enforcing per-workload memory limits and reporting usage without requiring per-node setup. It enables better utilization for smaller workloads, but a scheduler integration—such as KAI Scheduler—is still needed to place workloads and realize those gains.
NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog
Science, Technology & Innovation · Oct 13, 2026
NVIDIA has open-sourced the full Run:ai GPU orchestration platform and four independently deployable components as part of its DSX AI Factory Platform, enabling Kubernetes teams and AI-cloud partners to adopt or customize selected capabilities without a full migration, while enterprise support remains separately commercial and NGC downloads remain subject to NVIDIA licensing.
NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog
Science, Technology & Innovation · Oct 13, 2026
NVIDIA Model Streamer targets model-loading bottlenecks by streaming weights directly into GPU memory, with partner benchmarks reporting 3–6× faster startup and potential GPU-runtime savings; operators should evaluate cold-start frequency, storage topology, and network performance when optimizing inference costs.