Downloads · 30 days
10
14% of all-time downloads
Kerwin0113/GSW-Gemma3-4B-20251207-0019-GGUF
GSW-Gemma3-4B-20251207-0019-GGUF is a machine learning model from Kerwin0113. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- 微调模型: GSW-Gemma3-4B-20251207-0019 - 量化方法: q4km - 转换工具: llama.cpp (converthftogguf.py + llama-quantize)
Downloads · 30 days
10
14% of all-time downloads
All-time downloads
70
Public
Repo size
2.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.5 GB · 100%
From the Hugging Face model README
# 创建模型
ollama create gsw-gemma3-4b-20251207-0019 -f Modelfile
# 运行模型
ollama run gsw-gemma3-4b-20251207-0019
# 使用 GPU 加速 (ngl=99 表示所有层都放到 GPU)
./llama-cli -m GSW-Gemma3-4B-20251207-0019-q4_k_m.gguf -p "你的问题" -ngl 99
# 交互模式
./llama-cli -m GSW-Gemma3-4B-20251207-0019-q4_k_m.gguf -i -ngl 99
temperature: 0.7
top_p: 0.9
repetition_penalty: 1.05
max_tokens: 4096