Downloads · 30 days
93
2% of all-time downloads
Chungulus/Agents-A1-IQ4_XS-imatrix-gguf-fable5-calibrated
Agents-A1-IQ4_XS-imatrix-gguf-fable5-calibrated is a machine learning model from Chungulus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
Fable-5 trace calibrated imatrix GGUF quant of InternScience/Agents-A1.
Downloads · 30 days
93
2% of all-time downloads
All-time downloads
3.8K
Public
Repo size
18.7 GB
Likes
3
Public
Click a slice to open those files.
.gguf18.7 GB · 100%
From the Hugging Face model README
Fable-5 trace calibrated imatrix GGUF quant of InternScience/Agents-A1.
| File | Size | SHA-256 |
|---|---|---|
Agents-A1-IQ4_XS-imatrix-gguf-fable5-calibrated.gguf | 17.44 GiB | 67bb63a2f216f48ecbd8180510d5a930b4c7a053d195d1e798cc5fbeeb70cf18 |
llama-cli -hf Chungulus/Agents-A1-IQ4_XS-imatrix-gguf-fable5-calibrated:Agents-A1-IQ4_XS-imatrix-gguf-fable5-calibrated.gguf -p "Write a Python sorting function" -n 160
ollama create agents-a1-iq4_xs-imatrix -f Modelfile
ollama run agents-a1-iq4_xs-imatrix
| Use case | Recommendation |
|---|---|
| Recommended hardware | 16-24 GB RAM |
| Best for | efficient compact 4-bit |
F16 baseline mini accuracy: 89.58%. F16 baseline PPL on KL holdout: 13.0194.
| Metric | Value |
|---|---|
| Mini accuracy | 87.50% |
| Retention vs F16 | 97.67% |
| Mean KLD vs F16 | 0.020185 |
| Same top p | 92.06% |
Glint-Research/Fable-5-tracese05c417852fc59fd8da758e68b352732423ca0cb