Downloads · 30 days
77
10% of all-time downloads
Chungulus/Agents-A1-Q4_K_M-imatrix-gguf-fable5-calibrated
Agents-A1-Q4_K_M-imatrix-gguf-fable5-calibrated is a machine learning model from Chungulus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
Fable-5 trace calibrated imatrix GGUF quant of InternScience/Agents-A1.
Downloads · 30 days
77
10% of all-time downloads
All-time downloads
787
Public
Repo size
21.2 GB
Likes
6
Public
Click a slice to open those files.
.gguf21.2 GB · 100%
From the Hugging Face model README
Fable-5 trace calibrated imatrix GGUF quant of InternScience/Agents-A1.
| File | Size | SHA-256 |
|---|---|---|
Agents-A1-Q4_K_M-imatrix-gguf-fable5-calibrated.gguf | 19.71 GiB | 06361f183ec008c7052c0473a746f867c25779b1debb4a8a74a7cee27abc33d2 |
llama-cli -hf Chungulus/Agents-A1-Q4_K_M-imatrix-gguf-fable5-calibrated:Agents-A1-Q4_K_M-imatrix-gguf-fable5-calibrated.gguf -p "Write a Python sorting function" -n 160
ollama create agents-a1-q4_k_m-imatrix -f Modelfile
ollama run agents-a1-q4_k_m-imatrix
| Use case | Recommendation |
|---|---|
| Recommended hardware | 16-24 GB RAM |
| Best for | default recommendation |
F16 baseline mini accuracy: 89.58%. F16 baseline PPL on KL holdout: 13.0194.
| Metric | Value |
|---|---|
| Mini accuracy | 87.50% |
| Retention vs F16 | 97.67% |
| Mean KLD vs F16 | 0.015182 |
| Same top p | 93.65% |
Glint-Research/Fable-5-tracese05c417852fc59fd8da758e68b352732423ca0cb