Downloads · 30 days
9
20% of all-time downloads
AzureBlack/Euryale-1.4-L2-70B-exl2
Euryale-1.4-L2-70B-exl2 is a text generation model from AzureBlack. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
ExllamaV2 version of the model created by Sao10K!
Downloads · 30 days
9
20% of all-time downloads
All-time downloads
45
Public
Repo size
83.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors60.8 GB · 100%
From the Hugging Face model README
ExllamaV2 version of the model created by Sao10K!
Original Model https://huggingface.co/Sao10K/Euryale-1.4-L2-70B
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
Main branch is 7bpw 8h
6b8h is 6bpw 8h
2.5b8h is 2.5bpw 8h
gguf quants: https://huggingface.co/Sao10K/Euryale-1.4-L2-70B-GGUF
1.3, but better? I guess.
Base Merged Model ratios adjusted.
NSFL portion of Hesperus v1 dataset trained and applied.
LimaRP merged in at a ~25% weight at the end.
Subjectively better in some aspects eg. long form rp, worse than the other, eg. chat-style rps.
overall a minor improvement in my eyes.
1.5 will include Hesperus v2 dataset in its entirety.
format: alpaca.