Downloads · 30 days
11
27% of all-time downloads
LDCC_-_LDCC-SOLAR-10.7B-4bits
RichardErkhov/LDCC_-_LDCC-SOLAR-10.7B-4bits
LDCC_-_LDCC-SOLAR-10.7B-4bits is a text generation model from RichardErkhov. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
41
Public
Parameters
11B
6.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.7 GB · 100%
Parameter types
How the weights are stored.
U810.5B · 95%
Try a prompt
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
LDCC-SOLAR-10.7B - bnb 4bits
- Model creator: https://huggingface.co/LDCC/
- Original model: https://huggingface.co/LDCC/LDCC-SOLAR-10.7B/
Original model description:
license: cc-by-nc-4.0 language:
- ko
Model Card for LDCC-SOLAR-10.7B
Developed by : Wonchul Kim (Lotte Data Communication AI Technical Team)
Hardware and Software
- Hardware: We utilized an A100x4 * 1 for training our model
- Training Factors: We fine-tuned this model using a combination of the DeepSpeed library and the HuggingFace TRL Trainer / HuggingFace Accelerate
Method
- This model was trained using the learning method introduced in the SOLAR paper.
Base Model
- yanolja/KoSOLAR-10.7B-v0.1 (This model is no longer supported due to a tokenizer issue.)
Caution
- If you want to fine-tune this model, it is recommended to use the tokenizer.json and tokenizer_config.json files from revision v1.1.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 12, 2024
- Updated
- May 12, 2024