Downloads · 30 days
508
14% of all-time downloads
chatbench-distilgpt2-GGUF
ysn-rfd/chatbench-distilgpt2-GGUF
chatbench-distilgpt2-GGUF is a machine learning model from ysn-rfd. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Model creator: microsoft<br/ Original model: microsoft/chatbench-distilgpt2<br/ GGUF quantization: provided by ysn-rfd using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp f…
All-time downloads
3.7K
Public
Repo size
1.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf1.2 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025
- SHA
- 8738721e
Base models
Datasets
Model card
From the Hugging Face model README
chatbench-distilgpt2
Model creator: microsoft<br/>
Original model: microsoft/chatbench-distilgpt2<br/>
GGUF quantization: provided by ysn-rfd using llama.cpp<br/>
Special thanks
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
Use with Ollama
ollama run "hf.co/ysn-rfd/chatbench-distilgpt2-GGUF:Q3_K_M"
Use with LM Studio
lms load "ysn-rfd/chatbench-distilgpt2-GGUF"
Use with llama.cpp CLI
llama-cli --hf "ysn-rfd/chatbench-distilgpt2-GGUF:Q3_K_M" -p "The meaning to life and the universe is"
Use with llama.cpp Server:
llama-server --hf "ysn-rfd/chatbench-distilgpt2-GGUF:Q3_K_M" -c 4096
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025