Downloads · 30 days
645
6% of all-time downloads
Qwen1.5-32B-Chat-iMat-GGUF
qwp4w3hyb/Qwen1.5-32B-Chat-iMat-GGUF
Qwen1.5-32B-Chat-iMat-GGUF is a machine learning model from qwp4w3hyb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
11K
Public
Repo size
284 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf284 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Apr 5, 2024
- Updated
- Apr 6, 2024
- SHA
- 464ea0e4
Base models
Model card
From the Hugging Face model README
Qwen1.5-32B-Chat-iMat-GGUF
Source Model: Qwen/Qwen1.5-32B-Chat
Quantized with llama.cpp commit 46acb3676718b983157058aecf729a2064fc7d34
Imatrix was generated from the f16 gguf via this command:
./imatrix -c 512 -m $out_path/$base_quant_name -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
Using the dataset from here
- License
- other
- Languages
- en
- Created
- Apr 5, 2024
- Updated
- Apr 6, 2024