Downloads · 30 days
52
2% of all-time downloads
avar6/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-gguf
NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-gguf is a machine learning model from avar6. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Llamacpp mainline compatible gguf quants of nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16. Note that this is NOT the instruct tuned model, its nvidia's base checkpoint. These quants are made using the same scheme…
Downloads · 30 days
52
2% of all-time downloads
All-time downloads
2.1K
Public
Repo size
278 GB
Likes
1
Public
Click a slice to open those files.
.gguf278 GB · 100%
From the Hugging Face model README
Llamacpp mainline compatible gguf quants of nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16. Note that this is NOT the instruct tuned model, its nvidia's base checkpoint. These quants are made using the same scheme as Aes Sedai's optimized quants for nemotron ultra instruct. He graciously provided the imatrix and commands used for these. Though as of this commit (10June2026) llamacpp still needs to be patched in order to make nemotron ultra ggufs
With chat completions, this model has some artifacts and strings that show up in the chat but it responds well enough to turn based chatting. Using text completions in with the below instruct json, the model actually reaponds normally. Tested in silly tavern without thinking
{
"input_sequence": "<|im_start|>user",
"output_sequence": "<|im_start|>assistant\n<think></think>{{name}}:",
"last_output_sequence": "",
"system_sequence": "<|im_start|>system",
"stop_sequence": "<|im_end|>",
"wrap": true,
"macro": true,
"names_behavior": "none",
"activation_regex": "",
"first_output_sequence": "",
"skip_examples": false,
"output_suffix": "<|im_end|>\n",
"input_suffix": "<|im_end|>\n",
"system_suffix": "<|im_end|>\n",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"sequences_as_stop_strings": true,
"story_string_prefix": "",
"story_string_suffix": "",
"extensions": {},
"name": "ChatML - Super3 No Reasoning"
}