Downloads · 30 days
956
12% of all-time downloads
Qwen2.5-7B-Instruct-kowiki-qa-gguf
teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf
Qwen2.5-7B-Instruct-kowiki-qa-gguf is a text generation model from teddylee777. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
- ✅ Original model is beomi/Qwen2.5-7B-Instruct-kowiki-qa - ✅ Quantized by teddylee777 by using llama.cpp
All-time downloads
8.1K
Public
Repo size
79.3 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf79.3 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Sep 22, 2024
- Updated
- Sep 22, 2024
- SHA
- c4e8aa68
Model card
From the Hugging Face model README
📌 Notice
- ✅ Original model is beomi/Qwen2.5-7B-Instruct-kowiki-qa
- ✅ Quantized by teddylee777 by using llama.cpp
💬 Template
FROM Qwen2.5-7B-Instruct-kowiki-qa-Q8_0.gguf
TEMPLATE """{{- if .System }}
<|im_start|>system
{{ .System }}
<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}
<|im_end|>
<|im_start|>assistant
"""
SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. 모든 대답은 한국어로 해주세요."""
PARAMETER temperature 0
PARAMETER num_ctx 128000
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
🧑💻 Helpful Contents
- ✅ How to load HuggingFace GGUF into LM Studio
- ✅ How to test llama3 by using Ollama
- 🇰🇷 LangChain Tutorial in Korean
- 🔥 Please subscribe and support on YouTube
- Task
- Text Generation
- Type
- qwen2
- License
- apache-2.0
- Languages
- ko, en
- Created
- Sep 22, 2024
- Updated
- Sep 22, 2024