Downloads · 30 days
76
10% of all-time downloads
RPMix-4x7B-MoE
ChaoticNeutrals/RPMix-4x7B-MoE
RPMix-4x7B-MoE is a text generation model from ChaoticNeutrals. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A mixture of experts model using my best scoring RP models. This model should primarily be used for RP and creative writing.
All-time downloads
798
Public
Parameters
24.2B
48.3 GB on disk
Likes
9
Public
Repo makeup
Click a slice to open those files.
.safetensors48.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Mar 30, 2024
- Updated
- Mar 30, 2024
- SHA
- c9fb38c8
Try a prompt
Model card
From the Hugging Face model README
RPMix 4x7B MoE
A mixture of experts model using my best scoring RP models. This model should primarily be used for RP and creative writing.
base_model: ResplendentAI/DaturaCookie_7B
gate_mode: hidden
experts_per_token: 2
experts:
- source_model: ChaoticNeutrals/RP_Vision_7B
positive_prompts:
- "chat"
- "assistant"
- "tell me"
- "explain"
- "I want"
- source_model: ChaoticNeutrals/BuRP_7B
positive_prompts:
- "show me"
- "touch"
- "believe"
- "see"
- "love"
- source_model: ResplendentAI/DaturaCookie_7B
positive_prompts:
- "storywriting"
- "write"
- "scene"
- "story"
- "character"
- source_model: ChaoticNeutrals/Kool-Aid_7B
positive_prompts:
- "sensual"
- "sexual"
- "horny"
- "turned on"
- "intimate"
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Languages
- en
- Created
- Mar 30, 2024
- Updated
- Mar 30, 2024