Downloads · 30 days
8
2% of all-time downloads
xxx777xxxASD/L3-ChaoticSoliloquy-v2-4x8B-test
L3-ChaoticSoliloquy-v2-4x8B-test is a text generation model from xxx777xxxASD. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
(Maybe i'll change the waifu picture later.)
Downloads · 30 days
8
2% of all-time downloads
All-time downloads
355
Public
Parameters
24.9B
49.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors49.9 GB · 100%
From the Hugging Face model README
(Maybe i'll change the waifu picture later.)
TRY 1.5 or 1.0 INSTEAD AND CHECK IF THEY WORK BETTER, I DIDN'T TEST THIS VERSION BEFORE PUBLISHING
[!IMPORTANT]
GGUF quants
Experimental RP-oriented MoE, the idea was to get a model that would be equal to or better than the Mixtral 8x7B and it's finetunes in RP/ERP tasks.
The model has totally 25B parameters, of which ~13B are active.
Please feedback me if it's more stable than the previous version
base_model: L3_ChaosMaid_8B
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: ChaoticNeutrals_Poppy_Porpoise-0.72-L3-8B
- source_model: L3_ChaosMaid_8B
- source_model: openlynn_Llama-3-Soliloquy-8B-v2
- source_model: Sao10K_L3-Solana-8B-v1
models:
- model: jeiku_Chaos_RP_l3_8B
# No parameters necessary for base model
- model: NeverSleep_Llama-3-Lumimaid-8B-v0.1
parameters:
density: 0.5
weight: 0.5
merge_method: dare_ties
base_model: jeiku_Chaos_RP_l3_8B
parameters:
int8_mask: true
dtype: bfloat16
