Downloads · 30 days
3
3% of all-time downloads
Kerwin0113/XunziALLM-7B-20251207-GGUF
XunziALLM-7B-20251207-GGUF is a machine learning model from Kerwin0113. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- 原始模型: ccwu0918/XunziALLM - 量化方法: q4km - GGUF 文件: XunziALLM-7B-20251207-Q4KM.gguf - 转换时间: 2025-12-07
Downloads · 30 days
3
3% of all-time downloads
All-time downloads
116
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
# 创建模型
ollama create xunziallm-7b-20251207 -f Modelfile
# 运行模型
ollama run xunziallm-7b-20251207
# 使用 GPU 加速
./llama-cli -m XunziALLM-7B-20251207-Q4_K_M.gguf -p "你的问题" -ngl 99
# 交互模式
./llama-cli -m XunziALLM-7B-20251207-Q4_K_M.gguf -i -ngl 99
temperature: 0.7
top_p: 0.9
repetition_penalty: 1.05
max_tokens: 4096