Downloads · 30 days
20
4% of all-time downloads
YoAbriel/KodaLite-1.3B-GGUF
KodaLite-1.3B-GGUF is a text generation model from YoAbriel. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF versions of YoAbriel/KodaLite-1.3B.
Downloads · 30 days
20
4% of all-time downloads
All-time downloads
488
Public
Repo size
18.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.7 GB · 100%
From the Hugging Face model README
GGUF versions of YoAbriel/KodaLite-1.3B.
| File | Quant | Size | Use case |
|---|---|---|---|
| kodalite-f16.gguf | F16 | ~2.5 GB | Full precision reference |
| kodalite-Q8_0.gguf | Q8_0 | ~1.3 GB | Near-lossless |
| kodalite-Q4_K_M.gguf | Q4_K_M | ~800 MB | Best size/quality tradeoff |
llama-cli -m kodalite-Q4_K_M.gguf --reverse-prompt '<|end|>' -p '<|user|>\nHello\n<|assistant|>\n' -n 150
cat > Modelfile << EOF
FROM ./kodalite-Q4_K_M.gguf
TEMPLATE """<|user|>
{{ .Prompt }}
<|assistant|>
"""
PARAMETER stop "<|end|>"
EOF
ollama create kodalite -f Modelfile
ollama run kodalite
Load the .gguf file directly. Stop sequence: <|end|>
Apache 2.0