Downloads · 30 days
12
22% of all-time downloads
RP-Llama-4x8B-MoE
WesPro/RP-Llama-4x8B-MoE
RP-Llama-4x8B-MoE is a text generation model from WesPro. Use it when you need the model to write or continue text. It is set up for transformers.
This is a my first Llama 3 MoE model with the following configs:
All-time downloads
55
Public
Parameters
24.9B
49.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors49.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 5, 2024
- Updated
- May 20, 2024
- SHA
- 5d81813d
Try a prompt
Model card
From the Hugging Face model README
This is a my first Llama 3 MoE model with the following configs:
base_model: Llama-3-RPMerge-8B-SLERP
experts:
- source_model: Llama-3-RPMerge-8B-SLERP
- source_model: WesPro_Daring_Llama
- source_model: Chaos_RP_l3_8B
- source_model: llama-3-stinky-8B
It's meant for RP and does pretty well at it but I haven't tested it excessively yet.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 5, 2024
- Updated
- May 20, 2024