Downloads · 30 days
908
65% of all-time downloads
sillykiwi/Nemotron-H-4B-Instruct-128K-Q6_K-GGUF
Nemotron-H-4B-Instruct-128K-Q6_K-GGUF is a text generation model from sillykiwi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model was converted to GGUF format from nvidia/Nemotron-H-4B-Instruct-128K using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads · 30 days
908
65% of all-time downloads
All-time downloads
1.4K
Public
Repo size
3.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf3.7 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from nvidia/Nemotron-H-4B-Instruct-128K using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
KoboldCpp gives me errors when loading this. It is possible this quantization is corrupt.