Downloads · 30 days
58
1% of all-time downloads
DarkForest-20B-v2.0-GGUF-iMat
TeeZee/DarkForest-20B-v2.0-GGUF-iMat
DarkForest-20B-v2.0-GGUF-iMat is a machine learning model from TeeZee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
IMatrix file prepared witch context 4096 and 5521 chunks of wiki.test.raw. Original model info: DarkForest-20B-v2.0
All-time downloads
4.8K
Public
Repo size
133 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf133 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Mar 19, 2024
- Updated
- Apr 1, 2024
- SHA
- b7b5fc0b
Model card
From the Hugging Face model README
DarkForest 20B v2.0 - GGUF IMat quants
IMatrix file prepared witch context 4096 and 5521 chunks of wiki.test.raw. Original model info: DarkForest-20B-v2.0
q8_0:
- [5521]8.5016,
- Final estimate: PPL = 8.5016 +/- 0.02134
q6_k:
- [5521]8.5046,
- Final estimate: PPL = 8.5046 +/- 0.02136
q5_0:
- [5521]8.4903,
- Final estimate: PPL = 8.4903 +/- 0.02132
- [5521]8.5880,
- Final estimate: PPL = 8.5880 +/- 0.02162
- [5521]8.5906,
- Final estimate: PPL = 8.5906 +/- 0.02163
q4_0:
- [5521]8.5610,
- Final estimate: PPL = 8.5610 +/- 0.02151
- [5521]8.7283,
- Final estimate: PPL = 8.7283 +/- 0.02196
q2_K:
- [5521]9.2445
- Final estimate: PPL = 9.2445 +/- 0.02351
- [5521]9.8329,
- Final estimate: PPL = 9.8329 +/- 0.02452
- [5521]10.5170,
- Final estimate: PPL = 10.5170 +/- 0.02651
- [5521]13.9487,
- Final estimate: PPL = 13.9487 +/- 0.03502 - UNUSABLE, model is too small to be coherent in 1 bit.
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
- License
- other
- Created
- Mar 19, 2024
- Updated
- Apr 1, 2024