Downloads · 30 days
24
10% of all-time downloads
Linkbricks-Horizon-AI-Korean-LLAMA3blend-4x8b
Saxo/Linkbricks-Horizon-AI-Korean-LLAMA3blend-4x8b
Linkbricks-Horizon-AI-Korean-LLAMA3blend-4x8b is a text generation model from Saxo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<div align="center" <img src="http://www.linkbricks.com/wp-content/uploads/2024/11/fulllogo.png" / </div
All-time downloads
239
Public
Parameters
24.9B
49.9 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors49.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Jul 12, 2024
- Updated
- Dec 5, 2024
- SHA
- b24d4c3a
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
<div align="center"> <img src="http://www.linkbricks.com/wp-content/uploads/2024/11/fulllogo.png" /> </div>AI 와 빅데이터 분석 전문 기업인 Linkbricks의 데이터사이언티스트인 지윤성(Saxo) 이사가 meta-llama/Meta-Llama-3-8B를 베이스모델로 GCP상의 H100-80G 8개를 통해 SFT-DPO 훈련한 한글 기반 LLAMA3-8b 4개의 MoE(Mixture of Expert)모델. 토크나이저는 라마3랑 동일하며 한글 VOCA 확장은 하지 않은 버전 입니다. 일반질의응답(채팅)-의료-군사-코딩 특화 LLM을 통합
Dr. Yunsung Ji (Saxo), a data scientist at Linkbricks, a company specializing in AI and big data analytics, trained the meta-llama/Meta-Llama-3-8B base model on 8 H100-60Gs on GCP for 4 hours of instructional training (8000 Tokens). Accelerate, Deepspeed Zero-3 libraries were used.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Languages
- ko, en, ja, zh
- Created
- Jul 12, 2024
- Updated
- Dec 5, 2024