Downloads · 30 days
75
0% of all-time downloads
Astralis-4x34B
Weyaxi/Astralis-4x34B
Astralis-4x34B is a text generation model from Weyaxi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
34.3K
Public
Parameters
114B
227 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors227 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mixtral
- Access
- Public
- Created
- Jan 12, 2024
- Updated
- Jan 15, 2024
- SHA
- 51331181
Try a prompt
Model card
From the Hugging Face model README
More details coming soon.
Yaml Config to reproduce
base_model: nontoxic-bagel-34b-v0.2
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: bagel-dpo-34b-v0.2
positive_prompts: ["question answering", "Q:", science", "biology", "chemistry", "physics"]
negative_prompts: ["math", "reason", "mathematics", "solve", "count", "code", "python", "javascript", "programming", "algorithm"]
- source_model: Nous-Hermes-2-Yi-34B
positive_prompts: ["chat", "math", "reason", "mathematics", "solve", "count", "python", "javascript", "programming", "algorithm", "tell me", "assistant"]
- source_model: SUS-Chat-34B
positive_prompts: ["math", "reason", "mathematics", "solve", "count", "assistant"]
- source_model: yi-34B-v3
positive_prompts: [""]
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- other
- Created
- Jan 12, 2024
- Updated
- Jan 15, 2024