Back to feed

NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform

NVIDIA Technical Blog

Oct 13, 2026

10/13/2026

Open GPU Fractioning Operator Enables CUDA Memory Fractions In Kubernetes With Scheduler Integration To Improve Utilization

NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog

Science, Technology & Innovation · Oct 13, 2026

The GPU Fractioning Operator exposes CUDA 13.4-native GPU memory fractioning in Kubernetes, enforcing per-workload memory limits and reporting usage without requiring per-node setup. It enables better utilization for smaller workloads, but a scheduler integration—such as KAI Scheduler—is still needed to place workloads and realize those gains.


10/13/2026

NVIDIA Open-Sources Run AI Platform Within DSX AI Factory With Independent Modules And Separate Enterprise Support

NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog

Science, Technology & Innovation · Oct 13, 2026

NVIDIA has open-sourced the full Run:ai GPU orchestration platform and four independently deployable components as part of its DSX AI Factory Platform, enabling Kubernetes teams and AI-cloud partners to adopt or customize selected capabilities without a full migration, while enterprise support remains separately commercial and NGC downloads remain subject to NVIDIA licensing.


10/13/2026

Weight Streaming To GPU Memory Improves Startup Speed And Makes Remote Model Repositories Competitive With Local Copies

NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform · NVIDIA Technical Blog

Science, Technology & Innovation · Oct 13, 2026

NVIDIA Model Streamer targets model-loading bottlenecks by streaming weights directly into GPU memory, with partner benchmarks reporting 3–6× faster startup and potential GPU-runtime savings; operators should evaluate cold-start frequency, storage topology, and network performance when optimizing inference costs.