Downloads · 30 days
61
0% of all-time downloads
Llama2_init_Mistral
Cartinoe5930/Llama2_init_Mistral
Llama2_init_Mistral is a text generation model from Cartinoe5930. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.
All-time downloads
34.5K
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 19, 2024
- SHA
- fd3bcd36
Try a prompt
Model card
From the Hugging Face model README
Base Model - SOLAR-10.7B
This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.
Please check specific details in the GitHub Repository.
GitHub Repository: https://github.com/gauss5930/iDUS
🏆 HuggingFace Open LLM Leaderboard
| Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Average |
|---|---|---|---|---|---|---|---|
| Llama2_init_Mistral | 60.07 | 83.3 | 64.09 | 42.15 | 78.37 | 37.91 | 60.98 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Jan 16, 2024
- Updated
- Jan 19, 2024