Downloads · 30 days
83
38% of all-time downloads
redponike/Hunyuan-A13B-Instruct-GGUF
Hunyuan-A13B-Instruct-GGUF is a machine learning model from redponike. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF quants of tencent/Hunyuan-A13B-Instruct
Downloads · 30 days
83
38% of all-time downloads
All-time downloads
218
Public
Repo size
127 GB
Likes
0
Public
Click a slice to open those files.
.gguf127 GB · 100%
From the Hugging Face model README
GGUF quants of tencent/Hunyuan-A13B-Instruct
Using llama.cpp b5844 (commit 17a1f0d2d407040ee242e18dd79be8bb212cfcef)
The importance matrix was generated with calibration_datav3.txt.
All quants were generated/calibrated with the imatrix, including the K quants.
Quantized from BF16.