Downloads · 30 days
56
31% of all-time downloads
DeepQ-1.5B-gguf
Linzes/DeepQ-1.5B-gguf
DeepQ-1.5B-gguf is a machine learning model from Linzes. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
We advise you to clone llama.cpp and install it following the official guide. We follow the latest version of llama.cpp. In the following demonstration, we assume that you are running commands under the repository lla…
All-time downloads
182
Public
Repo size
9.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf9.6 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 26, 2025
- Updated
- Apr 27, 2025
- SHA
- 7bf773c6
Base models
Model card
From the Hugging Face model README
DeepQ-1.5B GGUF
Quick Start
We advise you to clone llama.cpp and install it following the official guide. We follow the latest version of llama.cpp. In the following demonstration, we assume that you are running commands under the repository llama.cpp.
Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use huggingface-cli:
Install
pip install -U huggingface_hub
Download:
huggingface-cli download Linzes/DeepQ-1.5B-gguf DeepQ-1.5B_Q5_K_M.gguf --local-dir . --local-dir-use-symlinks False
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
./llama-cli -m <gguf-file-path> \
-co -cnv -p "You are a helpful assistant." \
-fa -ngl 80 -n 512
- License
- apache-2.0
- Languages
- zh, en
- Created
- Apr 26, 2025
- Updated
- Apr 27, 2025