Downloads · 30 days
0
FluffyKaeloky/Euryale-Inverted-L2-70B-exl2-6.0bpw
Euryale-Inverted-L2-70B-exl2-6.0bpw is a text generation model from FluffyKaeloky. Use it when you need the model to write or continue text.
Exl2 version of Sao10K's Euryale-Inverted-L2-70B.
Downloads · 30 days
0
Access
Public
Updated Nov 30, 2023
Repo size
52.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors52.1 GB · 100%
From the Hugging Face model README
Exl2 version of Sao10K's Euryale-Inverted-L2-70B.
6.0 bpw version.
Model original card : https://huggingface.co/Sao10K/Euryale-Inverted-L2-70B
Tested with 16K context with alpha value, fits just below 60Gb of VRAM divided over 3 GPUs.