Downloads · 30 days
9
17% of all-time downloads
open-llama-7b-openthought-sft-lora
ping98k/open-llama-7b-openthought-sft-lora
open-llama-7b-openthought-sft-lora is a machine learning model from ping98k. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter for assistant-only SFT on OpenThoughts-114k (7B version).
All-time downloads
52
Public
Repo size
844 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors844 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Apr 14, 2026
- Updated
- Apr 14, 2026
- SHA
- db84dd16
Base models
Model card
From the Hugging Face model README
open-llama-7b-openthought-sft-lora
LoRA adapter for assistant-only SFT on OpenThoughts-114k (7B version).
Base model
This adapter is trained on top of ping98k/open-llama-7b-openthought-mid-4bit (the full-loss "mid" model).
Training
- Base: ping98k/open-llama-7b-openthought-mid-4bit
- Method: QLoRA (r=32, alpha=32)
- Data: open-thoughts/OpenThoughts-114k (filtered <= 2024 tokens, 10,582 samples)
- Epochs: 3
- Batch size: 64
- LR: 2e-4 (cosine, warmup 24 steps)
- Loss: assistant-only (system/user turns masked)
- Context: 2024 (native, no RoPE scaling)
- modules_to_save: embed_tokens, lm_head
Merged model
- Library
- peft
- Created
- Apr 14, 2026
- Updated
- Apr 14, 2026