Downloads · 30 days
75
4% of all-time downloads
L3_SnowStorm_4x8B
xxx777xxxASD/L3_SnowStorm_4x8B
L3_SnowStorm_4x8B is a text generation model from xxx777xxxASD. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
<style .image-container { position: relative; display: inline-block; }
All-time downloads
2.1K
Public
Parameters
24.9B
49.9 GB on disk
Likes
11
Public
Repo makeup
Click a slice to open those files.
.safetensors49.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- mixtral
- Access
- Public
- Created
- May 20, 2024
- Updated
- May 28, 2024
- SHA
- 152210ff
Try a prompt
Model card
From the Hugging Face model README
<style>
.image-container {
position: relative;
display: inline-block;
}
.image-container img {
display: block;
border-radius: 10px;
box-shadow: 0 0 1px rgba(0, 0, 0, 0.3);
}
.image-container::before {
content: "";
position: absolute;
top: 0px;
left: 20px;
width: calc(100% - 40px);
height: calc(100%);
background-image: url("https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/OuMe79ZQPdCX01rTdfgXn.png");
background-size: cover;
filter: blur(10px);
z-index: -1;
}
</style>
<br>
<div class="image-container">
<img src="https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/OuMe79ZQPdCX01rTdfgXn.png" style="width: 96%; margin: auto;" >
</div>
(Maybe i'll change the waifu picture later)
[!NOTE] GGUF/Exl2 quants
Experimental RP-oriented MoE, the idea was to get a model that would be equal to or better than Mixtral 8x7B and it's finetunes in RP/ERP tasks.
Llama 3 SnowStorm v1.0 4x8B
base_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1-OAS
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: ChaoticNeutrals_Poppy_Porpoise-v0.7-L3-8B
- source_model: NeverSleep_Llama-3-Lumimaid-8B-v0.1-OAS
- source_model: openlynn_Llama-3-Soliloquy-8B-v2
- source_model: Sao10K_L3-8B-Stheno-v3.1
Models used
- ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B
- NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
- openlynn/Llama-3-Soliloquy-8B-v2
- Sao10K/L3-8B-Stheno-v3.1
Difference(from ChaoticSoliloquy v1.5)
- Update from NeverSleep/Llama-3-Lumimaid-8B-v0.1 to NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
- Update from openlynn/Llama-3-Soliloquy-8B-v1 to openlynn/Llama-3-Soliloquy-8B-v2
- Update from Sao10K/L3-Solana-8B-v1 to Sao10K/L3-8B-Stheno-v3.1
Vision
Prompt format: Llama 3
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- llama3
- Languages
- en
- Created
- May 20, 2024
- Updated
- May 28, 2024