Downloads · 30 days
11
5% of all-time downloads
WarlordHermes/QwenLong-creative-ORPO-v5-Q4_K_M-GGUF
QwenLong-creative-ORPO-v5-Q4_K_M-GGUF is a machine learning model from WarlordHermes. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model was converted to GGUF format from WarlordHermes/QwenLong-creative-ORPO-v5 using llama.cpp via Convert Model to GGUF.
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
219
Public
Repo size
18.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf18.6 GB · 100%
From the Hugging Face model README
This model was converted to GGUF format from WarlordHermes/QwenLong-creative-ORPO-v5 using llama.cpp via
Convert Model to GGUF.
Key Features:
Refer to the original model card for more details on the base model.
1. Install llama.cpp:
brew install llama.cpp # For macOS/Linux
2. Run Inference:
CLI:
llama-cli --hf-repo WarlordHermes/QwenLong-creative-ORPO-v5-Q4_K_M-GGUF --hf-file qwenlong-creative-orpo-v5-q4_k_m.gguf -p "Your prompt here"
Server:
llama-server --hf-repo WarlordHermes/QwenLong-creative-ORPO-v5-Q4_K_M-GGUF --hf-file qwenlong-creative-orpo-v5-q4_k_m.gguf -c 2048
For more advanced usage, refer to the llama.cpp repository.