Back to Models
nvidia/nemotron-3-super-120b-a12b
Not Available

Nemotron 3 Super

NVIDIA Nemotron 3 Super is a 120B-parameter open hybrid MoE model, activating just 12B parameters for maximum compute efficiency and accuracy in complex multi-agent applications. Built on a hybrid Mamba-Transformer Mixture-of-Experts architecture with multi-token prediction (MTP), it delivers over 50% higher token generation compared to leading open models. The model features a 1M token context window for long-term agent coherence, cross-document reasoning, and multi-step task planning. Latent MoE enables calling 4 experts for the inference cost of only one, improving intelligence and generalization. Multi-environment RL training across 10+ environments delivers leading accuracy on benchmarks including AIME 2025, TerminalBench, and SWE-Bench Verified. Fully open with weights, datasets, and recipes under the NVIDIA Open License, Nemotron 3 Super allows easy customization and secure deployment anywhere — from workstation to cloud.

3/11/2026
262,144 tokens
#114 Text (English)
Specifications

Modalities

Input
text
Output
text

Supported Parameters

frequency_penalty
include_reasoning
max_tokens
min_p
presence_penalty
reasoning
repetition_penalty
response_format
seed
stop
temperature
tool_choice
tools
top_k
top_p
Leaderboard
Text
🏆OverallELO: 1,365
#125
🇬🇧EnglishELO: 1,390
#114
russianELO: 1,335
#138
💻CodingELO: 1,412
#123
🧮MathELO: 1,366
#122
✍️Creative WritingELO: 1,299
#163
📝Instruction FollowingELO: 1,354
#124
🌶️Hard PromptsELO: 1,385
#122
💬Multi-TurnELO: 1,369
#120