Downloads · 30 days
66
23% of all-time downloads
nabin2004/AOS-qwen3-8b-narrated-sft-gguf
AOS-qwen3-8b-narrated-sft-gguf is a text generation model from nabin2004. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Quantized GGUF versions of the Supervised Fine-Tuned (SFT) model for Manim Community Edition and manim-voiceover animation generation.
Downloads · 30 days
66
23% of all-time downloads
All-time downloads
281
Public
Repo size
13.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf13.7 GB · 100%
From the Hugging Face model README
Quantized GGUF versions of the Supervised Fine-Tuned (SFT) model for Manim Community Edition and manim-voiceover animation generation.
nabin2004/AOS-qwen3-8b-narrated-sft-mergednabin2004/AOS-qwen3-8b-narrated-adapter| File | Quantization | Size | Description |
|---|---|---|---|
aos-qwen3-8b-narrated-sft-Q4_K_M.gguf | Q4_K_M | ~5.03 GB | Recommended for fast consumer local inference (8GB+ RAM / VRAM). |
aos-qwen3-8b-narrated-sft-Q8_0.gguf | Q8_0 | ~8.71 GB | Near-lossless 8-bit precision. |
ollama run hf.co/nabin2004/AOS-qwen3-8b-narrated-sft-gguf
huggingface-cli download nabin2004/AOS-qwen3-8b-narrated-sft-gguf aos-qwen3-8b-narrated-sft-Q4_K_M.gguf Modelfile --local-dir ./model
cd ./model
ollama create aos-qwen3-8b-narrated-sft -f Modelfile
ollama run aos-qwen3-8b-narrated-sft