Downloads · 30 days
1.4K
9% of all-time downloads
DevQuasar-13/nvidia.Llama-3_1-Nemotron-Ultra-253B-v1-GGUF
nvidia.Llama-3_1-Nemotron-Ultra-253B-v1-GGUF is a text generation model from DevQuasar-13. Use it when you need the model to write or continue text.
Big thanks to ymcki for updating the llama.cpp code to support the 'dummy' layers. Use the llama.cpp branch from this PR: https://github.com/ggml-org/llama.cpp/pull/12843 if it hasn't been merged yet.
Downloads · 30 days
1.4K
9% of all-time downloads
All-time downloads
15.8K
Public
Repo size
754 GB
Likes
7
Public
Click a slice to open those files.
.gguf753 GB · 100%
From the Hugging Face model README
Big thanks to ymcki for updating the llama.cpp code to support the 'dummy' layers. Use the llama.cpp branch from this PR: https://github.com/ggml-org/llama.cpp/pull/12843 if it hasn't been merged yet.
Note the imatrix data used for the IQ quants has been produced from the Q4 quant!

'Make knowledge free for everyone'
Quantized version of: nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 <a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>