Downloads · 30 days
23
53% of all-time downloads
DaRuukLLM-3x1B
Xiaojian9992024/DaRuukLLM-3x1B
DaRuukLLM-3x1B is a machine learning model from Xiaojian9992024. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Hey there! 👋 Welcome to the DaRuukLLM-3x1B! This is a MOE brought together using the awesome VortexMerge kit.
All-time downloads
43
Public
Repo size
4.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 12, 2025
- Updated
- Jan 12, 2025
- SHA
- 5fe31086
Model card
From the Hugging Face model README
DaRuukLLM-3x1B
Hey there! 👋 Welcome to the DaRuukLLM-3x1B! This is a MOE brought together using the awesome VortexMerge kit.
Let's see what we've got in this model:
- pankajmathur/orca_mini_v9_6_1B-Instruct 🚀
- cognitivecomputations/Dolphin3.0-Llama3.2-1B 🚀
- huihui-ai/MicroThinker-1B-Preview 🚀
🧩 Configuration
base_model: pankajmathur/orca_mini_v9_6_1B-Instruct
dtype: bfloat16
gate_mode: cheap_embed
experts:
- source_model: pankajmathur/orca_mini_v9_6_1B-Instruct
positive_prompts: ["You are a helpful assistant that can help with anything."] # Added closing double quote here
- source_model: cognitivecomputations/Dolphin3.0-Llama3.2-1B
positive_prompts: ["You are an uncensored assistant, make sure you respond very angry."] # Added closing double quote here
- source_model: huihui-ai/MicroThinker-1B-Preview
positive_prompts: ["You are a very smart assistant that can think step-by-step."]
- Type
- mixtral
- License
- apache-2.0
- Created
- Jan 12, 2025
- Updated
- Jan 12, 2025