Downloads · 30 days
135
3% of all-time downloads
LongWriter-glm4-9B-GGUF
QuantPanda/LongWriter-glm4-9B-GGUF
LongWriter-glm4-9B-GGUF is a text generation model from QuantPanda. Use it when you need the model to write or continue text. The card lists the license as other.
Original model link: https://huggingface.co/THUDM/LongWriter-glm4-9b
All-time downloads
4.7K
Public
Repo size
81.8 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf81.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Aug 21, 2024
- Updated
- Aug 21, 2024
- SHA
- 8396e121
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
LongWriter-glm4-9b
Original model link: https://huggingface.co/THUDM/LongWriter-glm4-9b
Model by: THUDM
Quants by: QuantPanda
GGUF quantization for llama.cpp and similar applications.
Example:
./llama-cli -m LongWriter-glm4-9B-Q5_K_M.gguf -p "You are a helpful AI assistant." --conversation
If the model takes too long to load you can reduce the context size with --ctx-size
Example with smaller context size:
./llama-cli -m LongWriter-glm4-9B-Q5_K_M.gguf -p "You are a helpful AI assistant." --conversation --ctx-size 4096
- Task
- Text Generation
- License
- other
- Languages
- en
- Created
- Aug 21, 2024
- Updated
- Aug 21, 2024