Downloads · 30 days
17
16% of all-time downloads
hermes_3_tests_gv
gameversellc/hermes_3_tests_gv
hermes_3_tests_gv is a machine learning model from gameversellc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for hermes. The card lists the license as apache-2.0.
Quantized GGUF version of NousResearch/Hermes-3-Llama-3.2-3B
All-time downloads
104
Public
Repo size
1.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.9 GB · 100%
At a glance
- Library
- hermes
- License
- apache-2.0
- Access
- Public
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025
- SHA
- 54e8289f
Model card
From the Hugging Face model README
Hermes-3-Llama-3.2-3B Q4_0 GGUF
Quantized GGUF version of NousResearch/Hermes-3-Llama-3.2-3B
Model Details
- Base Model: NousResearch/Hermes-3-Llama-3.2-3B
- Quantization: Q4_0 (4-bit)
- Format: GGUF
- Size: 1.79 GB
- Use Case: Efficient inference with llama.cpp
Usage
With llama.cpp
# Download model
huggingface-cli download gameversellc/hermes_3_tests_gv Hermes-3-Llama-3.2-3B_q4_0.gguf
# Run inference
./llama-cli -m Hermes-3-Llama-3.2-3B_q4_0.gguf -p "Your prompt here" -n 100
With llama-cpp-python
from llama_cpp import Llama
llm = Llama(model_path="Hermes-3-Llama-3.2-3B_q4_0.gguf")
output = llm("Your prompt here", max_tokens=100)
print(output)
Performance
- MMLU Accuracy: ~40% (quantized)
- Inference Speed: Fast on CPU
- Memory Usage: ~2 GB RAM
License
Apache 2.0 (same as base model)
- Library
- hermes
- License
- apache-2.0
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025