Downloads · 30 days
1.2K
23% of all-time downloads
fableforge-ai/FableForge-1.5B-v2-GGUF
FableForge-1.5B-v2-GGUF is a text generation model from fableforge-ai. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quantizations of King3Djbl/FableForge-1.5B-v2, a 1.5B parameter model fine-tuned from FableForge-1.5B with continued pretraining for improved reasoning and tool use.
Downloads · 30 days
1.2K
23% of all-time downloads
All-time downloads
5.2K
Public
Repo size
22 GB
Likes
2
Public
Click a slice to open those files.
.gguf22 GB · 100%
From the Hugging Face model README
GGUF quantizations of King3Djbl/FableForge-1.5B-v2, a 1.5B parameter model fine-tuned from FableForge-1.5B with continued pretraining for improved reasoning and tool use.
| Quant | File | Size |
|---|---|---|
| F16 | FableForge-1.5B-v2-f16.gguf | 2.88 GB |
| Q8_0 | FableForge-1.5B-v2-q8_0.gguf | 1.53 GB |
| Q6_K | FableForge-1.5B-v2-q6_k.gguf | 1.19 GB |
| Q5_K_M | FableForge-1.5B-v2-q5_k_m.gguf | 1.05 GB |
| Q5_K_S | FableForge-1.5B-v2-q5_k_s.gguf | 1.02 GB |
| Q4_K_M | FableForge-1.5B-v2-q4_k_m.gguf | 0.92 GB |
| Q4_K_S | FableForge-1.5B-v2-q4_k_s.gguf | 0.87 GB |
| Q4_0 | FableForge-1.5B-v2-q4_0.gguf | 0.87 GB |
| Q4_1 | FableForge-1.5B-v2-q4_1.gguf | 0.97 GB |
| Q3_K_L | FableForge-1.5B-v2-q3_k_l.gguf | 0.79 GB |
| Q3_K_M | FableForge-1.5B-v2-q3_k_m.gguf | 0.77 GB |
| Q3_K_S | FableForge-1.5B-v2-q3_k_s.gguf | 0.70 GB |
| Q2_K | FableForge-1.5B-v2-q2_k.gguf | 0.63 GB |
| IQ4_NL | FableForge-1.5B-v2-iq4_nl.gguf | 0.84 GB |
| IQ4_XS | FableForge-1.5B-v2-iq4_xs.gguf | 0.83 GB |
| IQ3_M | FableForge-1.5B-v2-iq3_m.gguf | 0.69 GB |
| IQ3_S | FableForge-1.5B-v2-iq3_s.gguf | 0.65 GB |
| IQ3_XS | FableForge-1.5B-v2-iq3_xs.gguf | 0.62 GB |
| IQ3_XXS | FableForge-1.5B-v2-iq3_xxs.gguf | 0.55 GB |
| IQ2_XS | FableForge-1.5B-v2-iq2_xs.gguf | 0.44 GB |
| IQ2_S | FableForge-1.5B-v2-iq2_s.gguf | 0.48 GB |
| IQ2_XXS | FableForge-1.5B-v2-iq2_xxs.gguf | 0.48 GB |
| IQ1_S | FableForge-1.5B-v2-iq1_s.gguf | 0.41 GB |
./main -m FableForge-1.5B-v2-q4_k_m.gguf -p "Hello" -n 512
ollama run hf.co/fableforge-ai/FableForge-1.5B-v2-GGUF:Q4_K_M
FableForge-1.5B-v2FableForge-1.5B-GGUF