Downloads · 30 days
8
6% of all-time downloads
SKY-Ko-Solar-10.7B-lora
SkyOrbis/SKY-Ko-Solar-10.7B-lora
SKY-Ko-Solar-10.7B-lora is a text generation model from SkyOrbis. Use it when you need the model to write or continue text. It is set up for transformers.
Model Overview Model Name: SKY-Ko-Solar-10.7B-lora (Fine-Tuned with LoRA)
All-time downloads
126
Public
Parameters
10.7B
21.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jun 23, 2024
- Updated
- Sep 24, 2024
- SHA
- c52c5092
Model card
From the Hugging Face model README
Model Overview Model Name: SKY-Ko-Solar-10.7B-lora (Fine-Tuned with LoRA)
Model Type: Language Model
Base Model: Solar-10.7B
Fine-Tuning Technique: Low-Rank Adaptation (LoRA)
Description This model is based on the Solar-10.7B, a state-of-the-art language model, and has been fine-tuned using the LoRA. LoRA allows for efficient fine-tuning with fewer parameters, making the model more adaptable and faster to deploy for specific tasks.
Train GPU: A100
Training Time: 15 hours
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- ko
- Created
- Jun 23, 2024
- Updated
- Sep 24, 2024