Downloads · 30 days
13
5% of all-time downloads
JayhC/L3-ChaoticSoliloquy-v1.5-4x8B-8bpw-h8-exl2
L3-ChaoticSoliloquy-v1.5-4x8B-8bpw-h8-exl2 is a text generation model from JayhC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
<br/<br/ 8bpw/h8 exl2 quantization of xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B using default exllamav2 calibration dataset.
Downloads · 30 days
13
5% of all-time downloads
All-time downloads
258
Public
Repo size
25.4 GB
Likes
2
Public
Click a slice to open those files.
.safetensors25.4 GB · 100%
From the Hugging Face model README
<br/><br/> 8bpw/h8 exl2 quantization of xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B using default exllamav2 calibration dataset.
ORIGINAL CARD:

[!IMPORTANT]
GGUF / Exl2 quants
Experimental RP-oriented MoE, the idea was to get a model that would be equal to or better than the Mixtral 8x7B and it's finetunes in RP/ERP tasks. Im not sure but it should be better than the first version
base_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: ChaoticNeutrals_Poppy_Porpoise-v0.7-L3-8B
- source_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1
- source_model: openlynn_Llama-3-Soliloquy-8B
- source_model: Sao10K_L3-Solana-8B-v1
