Downloads · 30 days
28
1% of all-time downloads
xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B
L3-ChaoticSoliloquy-v1.5-4x8B is a text generation model from xxx777xxxASD. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Downloads · 30 days
28
1% of all-time downloads
All-time downloads
2.2K
Public
Parameters
24.9B
49.9 GB on disk
Likes
8
Public
Click a slice to open those files.
.safetensors49.9 GB · 100%
From the Hugging Face model README

[!IMPORTANT]
GGUF / Exl2 quants
Experimental RP-oriented MoE, the idea was to get a model that would be equal to or better than the Mixtral 8x7B and it's finetunes in RP/ERP tasks. Im not sure but it should be better than the first version
base_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: ChaoticNeutrals_Poppy_Porpoise-v0.7-L3-8B
- source_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1
- source_model: openlynn_Llama-3-Soliloquy-8B
- source_model: Sao10K_L3-Solana-8B-v1
