NVIDIA's Nemotron 3 Super 120B-A12B is part of the third generation of the Nemotron open model family — a series engineered specifically for building specialized, reliable AI agents rather than serving as a general-purpose chatbot. The "Super" designation marks a meaningful architectural step up from the lighter Nano variant, introducing several capabilities that simply weren't present before.
NVIDIA achieved this through their LatentMoE approach, where expert routing happens in a compressed latent space rather than full model dimensionality, meaning the system is smarter about which experts to engage, not just how many.
Tokens are first projected into a compressed latent space for expert routing and computation. This reduces the byte cost per unit of model intelligence — you call 4 experts but pay roughly the compute of 1. It's what makes the 12B active parameter count feel much larger than it is.
Rather than relying purely on attention, the model interleaves Mamba-2 state-space layers with selective attention blocks. Mamba-2 handles long-range context efficiently; attention handles local precision. The combination is faster than a dense transformer at long contexts.
Unlike models that predict one token at a time, Nemotron 3 Super uses MTP layers as a native speculative decoding mechanism. This is what drives the 167+ tokens/sec output speed — it's not just hardware, it's baked into the model weights.
The Super model is the first in its family pretrained at NVFP4 precision rather than using it only for post-training quantization. This allowed training on the full 25T+ token corpus more efficiently without sacrificing the quality typically expected of BF16-trained models.
Not just a theoretical maximum — the model outperforms both GPT-OSS-120B and Qwen3.5-122B on the RULER benchmark at the full 1M token setting. This matters for agent workflows where conversation and tool-use history must stay in context across hundreds of steps.
Reasoning behavior is toggled via a flag in the chat template. When enabled, the model generates an internal reasoning trace before its final response — useful for complex multi-step tasks. When disabled, it responds directly, reducing latency for simpler queries.
Benchmark scores are only meaningful when you know what they're measuring. Below are the evaluations most relevant to real-world developer use cases — not cherry-picked academic tasks, but coding agents, long-context retrieval, math reasoning, and instruction-following under load.
| Benchmark | What It Tests | Score | Notes |
|---|---|---|---|
| AIME 2025 | Competitive math reasoning | Leading open score | Multi-environment RL training cited as key driver |
| SWE-Bench Verified | Real GitHub issue resolution | Top open model tier | Tested as a full coding agent, not just code completion |
| TerminalBench | CLI agent task completion | Leading open model | Requires multi-step tool use in terminal environments |
| PinchBench | Coding agent accuracy | 85.6% | Best open model result at time of release |
| RULER @ 1M ctx | Long-range retrieval accuracy | Outperforms GPT-OSS-120B | Also beats Qwen3.5-122B at full 1M token length |
| AA Intelligence Index v4 | Composite reasoning score | 36 / avg 15 | Well above average among comparable open-weight models |
| Throughput vs. GPT-OSS-120B | Tokens per second at scale | 2.2× faster | 8k input / 64k output setting |
| Throughput vs. Qwen3.5-122B | Tokens per second at scale | 7.5× faster | Same test setting as above |
This isn't a model you deploy for simple question-and-answer flows. It's built for sustained, multi-step, tool-using workflows where context accumulates and reasoning chains span dozens of decisions. Here's where it genuinely earns its keep.
Designed from the ground up for collaborative agent pipelines. The million-token context lets it track complete state across planner, researcher, and executor sub-agents without truncation.
SWE-Bench Verified and PinchBench scores reflect performance on actual repositories — filing fixes, navigating codebases, and executing across a terminal. Not just code generation.
High-volume workloads like IT ticket triage are a primary design target. The MoE architecture keeps per-call compute costs low even when request volume is sustained.
Cross-document aggregation and multi-document reasoning were explicitly part of the fine-tuning data. Useful for legal review, technical due diligence, and research summarization.
Fine-tuned on structured output tasks explicitly. JSON schema adherence, tool-call formatting, and instruction-following with complex constraints are reliable in production settings.
Pre-training included substantial synthetic math and science data. Reinforcement learning across 10+ environments — including formal reasoning — drove the AIME 2025 benchmark results.
Measured on the AI/ML API gateway across live traffic. Figures are medians unless stated. Last updated 2026-10-12.
This model is documented as suited to agentic workflows, including collaborative agents and multi-agent applications.
It is also documented for high-volume workloads such as IT ticket automation.
It is documented for RAG systems, including retrieval-augmented generation and full-document retrieval workflows.
It is documented for complex instruction-following and long-context reasoning tasks.
import requests r = requests.post( "https://api.aimlapi.com/v1/chat/completions", headers={"Authorization": "Bearer " + AIMLAPI_KEY}, json={ "model": "nvidia/nemotron-3-super-120b-a12b", "messages": [ { "role": "user", "content": "Hello!" } ] }, ) print(r.json())
const r = await fetch("https://api.aimlapi.com/v1/chat/completions", { method: "POST", headers: { Authorization: `Bearer ${process.env.AIMLAPI_KEY}`, "Content-Type": "application/json", }, body: JSON.stringify({ "model": "nvidia/nemotron-3-super-120b-a12b", "messages": [ { "role": "user", "content": "Hello!" } ] }), }); console.log(await r.json());
curl -X POST https://api.aimlapi.com/v1/chat/completions \ -H "Authorization: Bearer $AIMLAPI_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"nvidia/nemotron-3-super-120b-a12b","messages":[{"role":"user","content":"Hello!"}]}'
OpenAI-compatible — swap the base URL and it works with your existing SDK.
| Type | Price |
|---|---|
| Input | |
| Output | |
| Benchmark | Score | What it measures | Source | Retrieved |
|---|---|---|---|---|
| GPQA Diamond | 79.2% | Google-proof graduate science questions (hardest subset) | Source | July 12, 2026 |
| Intelligence | 13.6 | Composite score across standardised reasoning, knowledge and problem-solving evaluations, measured independently by Artificial Analysis | Source | September 12, 2026 |
| Coding | 37.7 | Composite score across standardised coding evaluations, measured independently by Artificial Analysis | Source | September 12, 2026 |
| Model | Input | Output | Context | Best for |
|---|---|---|---|---|
Nemotron 3 Super 120B-A12B This page | Coding + agents | |||
| Reasoning + agents | ||||
| Balanced coding + agents | ||||
| Long-context, multimodal & agentic workflows | ||||
| Reasoning + agents |
Nemotron 3 Super 120B-A12B has a 262,144 tokens context window and can return up to 262,144 tokens.
Nemotron 3 Super 120B-A12B takes text as input and returns text.
Use nvidia/nemotron-3-super-120b-a12b as the model id. Requests go to https://api.aimlapi.com/v1/chat/completions.
Nemotron 3 Super 120B-A12B became available on April 30, 2026.
Nemotron 3 Super 120B-A12B is priced at input $0.123786 / 1M tokens, output $0.61893 / 1M tokens.
Yes, Nemotron 3 Super 120B-A12B can stream responses as they are generated.
Nemotron 3 Super 120B-A12B was built by NVIDIA.
Yes, it supports function calling along with parallel tool calls.
Yes, structured output is listed as a supported feature and capability.
