Downloads · 30 days
31
25% of all-time downloads
Llama3.2-1B-summary-length-exp2
amang1802/Llama3.2-1B-summary-length-exp2
Llama3.2-1B-summary-length-exp2 is a text generation model from amang1802. Use it when you need the model to write or continue text. It is set up for transformers.
- Summary Length PPO experiment 2 - No KL divergence in loss
All-time downloads
125
Public
Parameters
1.2B
2.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Nov 21, 2024
- Updated
- Nov 21, 2024
- SHA
- bd028bc8
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
- Summary Length PPO experiment #2
- No KL divergence in loss
Model Details
- Dataset size: 1024
- Epochs: 2
- Batch Size: 4 * 8 (using Grad Accu)
Optimizer args: Torch AdamW default, except
- LR = 0.0001
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Nov 21, 2024
- Updated
- Nov 21, 2024