Downloads · 30 days
12
29% of all-time downloads
Smoltaur-1.7B-LoRA-r64
socius/Smoltaur-1.7B-LoRA-r64
Smoltaur-1.7B-LoRA-r64 is a text generation model from socius. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
<div align="center" <img src="Smoltaur-1.7B-LoRA-r64.png" alt="Smoltaur-1.7B-LoRA-r64" width="1000"
All-time downloads
41
Public
Repo size
1.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.4 GB · 70%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Jul 25, 2026
- Updated
- Aug 7, 2026
- SHA
- 8dec72d9
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
<div align="center">
<img src="Smoltaur-1.7B-LoRA-r64.png" alt="Smoltaur-1.7B-LoRA-r64" width="1000">
Smoltaur-1.7B-LoRA-r64
LoRA adapter for Smoltaur-1.7B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.
| field | value |
|---|---|
| base model | unsloth/SmolLM2-1.7B |
| LoRA rank | 64 (alpha = rank, rsLoRA) |
| data fraction | 100% of Psych-101 |
| training | 1 epoch, completion-only loss, seed 3407 |
Load with PEFT on top of unsloth/SmolLM2-1.7B, or evaluate with the project's
eval_model.py --backend unsloth.
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Jul 25, 2026
- Updated
- Aug 7, 2026