Downloads · 30 days
80
7% of all-time downloads
GigaChat3-10B-A1.8B-GGUF
evilfreelancer/GigaChat3-10B-A1.8B-GGUF
GigaChat3-10B-A1.8B-GGUF is a text generation model from evilfreelancer. Use it when you need the model to write or continue text. The card lists the license as mit.
This requires llama.cpp PR17420 to properly detect as a deepseek lite model.
All-time downloads
1.1K
Public
Repo size
32.7 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf32.7 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Nov 20, 2025
- Updated
- Nov 21, 2025
- SHA
- 4aa2cdc7
Base models
Model card
From the Hugging Face model README
Quantized version of ai-sage/GigaChat3-10B-A1.8B-bf16
This requires llama.cpp PR#17420 to properly detect as a deepseek lite model.
And this chat_template.jinja.
Quick Start
export CUDA_VISIBLE_DEVICES=0
export model="./output/GigaChat3-10B-A1.8B-f16.gguf"
./build/bin/llama-server \
--model "$model" \
--ctx-size 2000 \
--parallel 1 \
--threads 8 \
--host 0.0.0.0 \
--port 8088 \
-cmoe \
--jinja \
--chat-template-file ./output/chat_template.jinja
- Task
- Text Generation
- License
- mit
- Languages
- ru, en
- Created
- Nov 20, 2025
- Updated
- Nov 21, 2025