Downloads · 30 days
283
7% of all-time downloads
L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX
v000000/L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX
L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX is a machine learning model from v000000. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
3.9K
Public
Repo size
65 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf65 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 29, 2024
- Updated
- Aug 30, 2024
- SHA
- 1e193d7d
Base models
Model card
From the Hugging Face model README
Llama-3.1-Niitorm-8B-LATCOSx2
Ordered by quality:
- q8_0 imatrix
- q8_0
- q6_k imatrix
- q6_k
- q5_k_m imatrix
- q5_k_s imatrix
- q4_k_m imatrix
- q4_k_s imatrix
- iq4_xs imatrix
- q4_0_4_8 imatrix arm
- q4_0_4_4 imatrix arm
This is a test RP model, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote <b>"LATCOS"</b>, which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction. This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. The model seems a lot smarter even though it's just a bit more of storm, but also more compliant which could be a negative since it's less "dynamic".
<i>imatrix data randomized bartowski, kalomeze, rp snippets, working gpt4 code, human messaging, story</i>
- Created
- Aug 29, 2024
- Updated
- Aug 30, 2024