Downloads · 30 days
48
10% of all-time downloads
chatbench-llama3-8b-GGUF
ysn-rfd/chatbench-llama3-8b-GGUF
chatbench-llama3-8b-GGUF is a machine learning model from ysn-rfd. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as llama3.
Model creator: microsoft<br/ Original model: microsoft/chatbench-llama3-8b<br/ GGUF quantization: provided by ysn-rfd using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp fo…
All-time downloads
468
Public
Repo size
23.5 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf23.5 MB · 100%
At a glance
- Library
- peft
- License
- llama3
- Access
- Public
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025
- SHA
- e4331991
Base models
Datasets
Model card
From the Hugging Face model README
chatbench-llama3-8b
Model creator: microsoft<br/>
Original model: microsoft/chatbench-llama3-8b<br/>
GGUF quantization: provided by ysn-rfd using llama.cpp<br/>
Special thanks
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
Use with Ollama
ollama run "hf.co/ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0"
Use with LM Studio
lms load "ysn-rfd/chatbench-llama3-8b-GGUF"
Use with llama.cpp CLI
llama-cli --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -p "The meaning to life and the universe is"
Use with llama.cpp Server:
llama-server --hf "ysn-rfd/chatbench-llama3-8b-GGUF:Q5_0" -c 4096
- Library
- peft
- License
- llama3
- Languages
- en
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025