Downloads · 30 days
9
14% of all-time downloads
llama-50m-dpo-sharegpt
nowefnyieryfner/llama-50m-dpo-sharegpt
llama-50m-dpo-sharegpt is a text generation model from nowefnyieryfner. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
An aligned, instruction-following Llama-style model based on the 50m parameters base architecture.
All-time downloads
65
Public
Repo size
346 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin229 MB · 66%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Jul 11, 2026
- Updated
- Jul 11, 2026
- SHA
- b1718e23
Try a prompt
Model card
From the Hugging Face model README
Llama-50m-DPO-ShareGPT
An aligned, instruction-following Llama-style model based on the 50m parameters base architecture.
Model Details
- Base Model: llama-50m-base
- Features: Rotary Position Embeddings (RoPE), RMSNorm, SwiGLU MLP, No Bias
- Alignment Stages:
- SFT: Fine-tuned on the ShareGPT dataset for 500 steps.
- DPO: Aligned on 255 preference pairs judged by Gemini-1.5-Pro for 100 steps.
Load and Run
You can use the Hugging Face Hub library to run generation dynamically:
# Download and run generate.py from the repository
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en, code
- Created
- Jul 11, 2026
- Updated
- Jul 11, 2026