Downloads · 30 days
636
14% of all-time downloads
hitonet/hito-1.7b-GGUF
hito-1.7b-GGUF is a text generation model from hitonet. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
636
14% of all-time downloads
All-time downloads
4.6K
Public
Repo size
34.4 GB
Likes
1
Public
Click a slice to open those files.
.gguf17.2 GB · 100%
From the Hugging Face model README
This repository contains GGUF quantized versions of hitonet/hito-1.7b.
Hito is a 1.7B parameter model with structured thinking patterns that enable better accuracy and transparency.
For the original model (safetensors), training details, benchmarks, and full documentation, see the main repository.
| File | Quant | Size | Quality | Notes |
|---|---|---|---|---|
| hito-1.7b-Q4_K_M.gguf | Q4_K_M | 1.1 GB | BEST | Perfect balance of size and quality |
| hito-1.7b-Q5_K_M.gguf | Q5_K_M | 1.2 GB | Excellent | Slightly better than Q4_K_M |
| hito-1.7b-Q8_0.gguf | Q8_0 | 1.8 GB | Excellent | Highest quality quantization |
| File | Quant | Size | Quality | Notes |
|---|---|---|---|---|
| hito-1.7b-Q4_0.gguf | Q4_0 | 1.0 GB | Good | Legacy format, works well |
| hito-1.7b-Q4_K_S.gguf | Q4_K_S | 1.0 GB | Good | Smaller Q4 variant |
| hito-1.7b-Q5_0.gguf | Q5_0 | 1.2 GB | Good | Legacy 5-bit |
| hito-1.7b-Q5_K_S.gguf | Q5_K_S | 1.2 GB | Good | Smaller Q5 variant |
| hito-1.7b-Q6_K.gguf | Q6_K | 1.4 GB | Excellent | Near full quality |
| hito-1.7b-F16.gguf | F16 | 3.3 GB | Reference | Full precision GGUF |
| File | Quant | Size | Quality | Notes |
|---|---|---|---|---|
| hito-1.7b-Q3_K_L.gguf | Q3_K_L | 957 MB | Fair | May get stuck in thinking |
| hito-1.7b-Q3_K_M.gguf | Q3_K_M | 896 MB | Fair | Occasional issues |
| hito-1.7b-Q3_K_S.gguf | Q3_K_S | 827 MB | Fair | Noticeable quality loss |
| File | Quant | Size | Quality | Notes |
|---|---|---|---|---|
| hito-1.7b-Q2_K.gguf | Q2_K | 742 MB | Broken | Produces gibberish |
# Download the recommended quantization
wget https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf
# Create Modelfile
cat > Modelfile << 'EOF'
FROM hito-1.7b-Q4_K_M.gguf
SYSTEM "You are Hito by Hitonet.com."
PARAMETER temperature 0.7
PARAMETER stop "<|im_end|>"
EOF
# Create and run
ollama create hito -f Modelfile
ollama run hito
./llama-cli -m hito-1.7b-Q4_K_M.gguf \
-sys "You are Hito by Hitonet.com." \
-p "What is your name?" \
-n 256
You are Hito by Hitonet.com.These GGUF files work with:
<think> tags for transparent reasoningFor full documentation, benchmarks, and training details, see the main repository.
| Component | License | Commercial Use |
|---|---|---|
| Model Weights | Apache 2.0 | ✅ Free to use |
| Training Methodology | Proprietary | ⚠️ Commercial License Required |
The model weights are open source under Apache 2.0. You may use, modify, and distribute them freely.
The training methodology and cognitive framework used to create this model are proprietary to Hitonet.
Commercial use of the training methodology requires a license.
Attribution is mandatory when using this model or discussing its capabilities.
For commercial licensing inquiries: [email protected]