Downloads · 30 days
20
0% of all-time downloads
ME-MOE-7Bx2_test
Jaehyeon222/ME-MOE-7Bx2_test
ME-MOE-7Bx2_test is a text generation model from Jaehyeon222. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-nd-4.0.
All-time downloads
18K
Public
Parameters
12.9B
50.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors25.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-nd-4.0
- Model type
- mixtral
- Access
- Public
- Created
- Jan 29, 2024
- Updated
- Feb 1, 2024
- SHA
- e12b0107
Model card
From the Hugging Face model README
Model Card for ME-MOE-7Bx2_test
Developed by : 메가스터디교육, 프리딕션, 마이스
Base Model : megastudyedu/ME-dpo-7B-v1.0
Expert Models : megastudyedu/ME-dpo-7B-v1.1, macadeliccc/WestLake-7B-v2-laser-truthy-dpo
Method : merge-kit을 활용하여 MOE를 구현했습니다.
ME-7B-v1.0 -> ME-dpo-7B-v1.0, ME-7B-v1.1 -> ME-dpo-7B-v1.1 로 수정했습니다.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- cc-by-nc-nd-4.0
- Languages
- ko
- Created
- Jan 29, 2024
- Updated
- Feb 1, 2024