Downloads · 30 days
5
12% of all-time downloads
MoEprometheus/Eyelock-350M
Eyelock-350M is a machine learning model from MoEprometheus. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GQA · SwiGLU · RoPE · RMSNorm · bfloat16
Downloads · 30 days
5
12% of all-time downloads
All-time downloads
43
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
.json2.8 MB · 100%
From the Hugging Face model README
GQA · SwiGLU · RoPE · RMSNorm · bfloat16
| Параметры | ~350M |
| Слои | 24 |
| d_model | 1024 |
| GQA | 16Q/4KV |
| Контекст | 2048 |
| Словарь | 40,000 BPE |
Диалог: <user>вопрос<assistant>ответ<eos>