Any-to-Any
Transformers
Safetensors
PyTorch
NemotronH_Nano_Omni_Reasoning_V3
feature-extraction
nvidia
multimodal
custom_code
8-bit precision
modelopt
Instructions to use nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
`modeling_nemotron_h.py` missing `supports_gradient_checkpointing = True` (same as BF16/FP8)
#7 opened 13 days ago
by
IshiiKosuke
Process to get this running on a DGX Spark with vLLM
#6 opened 14 days ago
by
thinkitdata
Disappointed: English-only support for an omni model in 2026?
🔥 5
#5 opened 21 days ago
by
mrwd2005