Downloads · 30 days
2
2% of all-time downloads
Kerwin0113/GSW-Gemma3-270M-20251206-1636-GGUF
GSW-Gemma3-270M-20251206-1636-GGUF is a machine learning model from Kerwin0113. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- 微调模型: GSW-Gemma3-270M-20251206-1636 - 基座模型: unsloth/gemma-3-270m-it - 量化方法: q4km - Chat Template: gemma-3 - 训练框架: Unsloth + TRL
Downloads · 30 days
2
2% of all-time downloads
All-time downloads
81
Public
Repo size
253 MB
Likes
0
Public
Click a slice to open those files.
.gguf253 MB · 100%
From the Hugging Face model README
gemma-3# 创建模型
ollama create gsw-gemma3-270m-20251206-1636 -f Modelfile
# 运行模型
ollama run gsw-gemma3-270m-20251206-1636
# 使用 GPU 加速 (ngl=99 表示所有层都放到 GPU)
./llama-cli -m GSW-Gemma3-270M-20251206-1636-Q4_K_M.gguf -p "你的问题" -ngl 99
# 交互模式
./llama-cli -m GSW-Gemma3-270M-20251206-1636-Q4_K_M.gguf -i -ngl 99
gemma-3gemma-3temperature: 0.7
top_p: 0.9
repetition_penalty: 1.05
max_tokens: 4096