Downloads · 30 days
11
13% of all-time downloads
Kerwin0113/GSW-EduChat-1.8B-20251207-1201-GGUF
GSW-EduChat-1.8B-20251207-1201-GGUF is a machine learning model from Kerwin0113. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- 微调模型: GSW-EduChat-1.8B-20251207-1201 - 基座模型: ecnu-icalk/educhat-sft-002-1.8b-qwen1.5 - 量化方法: q4km - Chat Template: chatml - 训练框架: Unsloth + TRL
Downloads · 30 days
11
13% of all-time downloads
All-time downloads
82
Public
Repo size
1.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.2 GB · 100%
From the Hugging Face model README
chatml# 创建模型
ollama create gsw-educhat-1.8b-20251207-1201 -f Modelfile
# 运行模型
ollama run gsw-educhat-1.8b-20251207-1201
# 使用 GPU 加速 (ngl=99 表示所有层都放到 GPU)
./llama-cli -m GSW-EduChat-1.8B-20251207-1201-Q4_K_M.gguf -p "你的问题" -ngl 99
# 交互模式
./llama-cli -m GSW-EduChat-1.8B-20251207-1201-Q4_K_M.gguf -i -ngl 99
chatmlchatmltemperature: 0.7
top_p: 0.9
repetition_penalty: 1.05
max_tokens: 4096