← Wednesday, October 7, 2026Performance & OSDeep dive

CUDA green contexts cut a critical kernel's latency from 0.140 ms to 0.007 ms

developer.nvidia.com by Elizabeth Goodman 8 min read Editor score 8/10

CUDA 13.1 green contexts let applications reserve GPU resources such as SMs for selected work; NVIDIA reports latency falling from 0.140 ms to 0.007 ms on a Blackwell GPU. This offers a concrete way to isolate latency-sensitive kernels from bulk workloads.

What

- CUDA green contexts let applications select subsets of GPU execution resources and target work to them within a single process.

How

- Applications can assign SMs and provision workqueues to green contexts, reducing competition and unintended serialization.

Why it matters

- In the reported Blackwell example, assigning dedicated SMs cut critical kernel latency from 0.140 ms to 0.007 ms.

Read on developer.nvidia.com →

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.