Downloads · 30 days
6
16% of all-time downloads
socius/Llama-Centaur-8B-LoRA-r4
Llama-Centaur-8B-LoRA-r4 is a text generation model from socius. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.1.
<div align="center" <img src="Llama-Centaur-8B-LoRA-r4.png" alt="Llama-Centaur-8B-LoRA-r4" width="1000"
Downloads · 30 days
6
16% of all-time downloads
All-time downloads
37
Public
Repo size
274 MB
Likes
0
Public
Click a slice to open those files.
.safetensors210 MB · 54%
From the Hugging Face model README
LoRA adapter for Llama-Centaur-8B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.
| field | value |
|---|---|
| base model | unsloth/Llama-3.1-8B |
| LoRA rank | 4 (alpha = rank, rsLoRA) |
| data fraction | 100% of Psych-101 |
| training | 1 epoch, completion-only loss, seed 3407 |
Load with PEFT on top of unsloth/Llama-3.1-8B, or evaluate with the project's
eval_model.py --backend unsloth.