Downloads · 30 days
81
2% of all-time downloads
Qwen-GGUF
Lemmih/Qwen-GGUF
Qwen-GGUF is a machine learning model from Lemmih. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
4.4K
Public
Repo size
110 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf110 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Dec 13, 2023
- Updated
- Dec 17, 2023
- SHA
- d63d66ae
Model card
From the Hugging Face model README
Quantized Qwen models for llama.cpp
Download a model:
huggingface-cli download Lemmih/Qwen-GGUF qwen-1_8b-chat-q4_0.gguf --local-dir .
Run the model (from the folder where you built llama.cpp):
./main --model qwen-1_8b-chat-q4_0.gguf -i -cml -f prompts/chat-with-qwen.txt
If in doubt, use the chat models rather than the non-chat models.
- License
- other
- Created
- Dec 13, 2023
- Updated
- Dec 17, 2023