krevas

SOLAR-10.7B

krevas/SOLAR-10.7B

SOLAR-10.7B is a text generation model from krevas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Hardware: We utilized an A100x4 1 for training our model Training Factors: We fine-tuned this model using a combination of the DeepSpeed library and the HuggingFace TRL Trainer / HuggingFace Accelerate