Downloads · 30 days
11
3% of all-time downloads
aixsatoshi/Llama-3-Elyza-Youko-moe-2x8B
Llama-3-Elyza-Youko-moe-2x8B is a text generation model from aixsatoshi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Downloads · 30 days
11
3% of all-time downloads
All-time downloads
341
Public
Parameters
13.7B
27.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors27.3 GB · 100%
From the Hugging Face model README
base_model: rinna/llama-3-youko-8b
gate_mode: random # "hidden", "cheap_embed", "random" の中から選択
dtype: bfloat16
experts_per_token: 2 # 各トークンに対してアクティブなエキスパートの数
experts:
- source_model: aixsatoshi/Llama-3-youko-8b-instruct-chatvector
- source_model: elyza/Llama-3-ELYZA-JP-8B