Downloads · 30 days
6
4% of all-time downloads
Llama-3.2-1B-samsun
aptro/Llama-3.2-1B-samsun
Llama-3.2-1B-samsun is a summarization model from aptro. Use it when you need a shorter version of a longer text. It is set up for peft. The card lists the license as llama2.
This is a LoRA adapter trained on the SAMSum dataset for dialogue summarization using meta-llama/Llama-3.2-1B as the base model.
All-time downloads
166
Public
Repo size
3.4 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.4 MB · 100%
At a glance
- Task
- Summarization
- Library
- peft
- License
- llama2
- Access
- Public
- Created
- Apr 30, 2025
- Updated
- Apr 30, 2025
- SHA
- f13a038e
Try a prompt
Base models
Model card
From the Hugging Face model README
🦙 LLaMA 3.2 1B + SAMSum LoRA Adapter
This is a LoRA adapter trained on the SAMSum dataset for dialogue summarization using meta-llama/Llama-3.2-1B as the base model.
🛠️ Training Details
- Base model:
meta-llama/Llama-3.2-1B - LoRA config: r=8, alpha=32, dropout=0.01
- Epochs: 1
- Batch size: 1 (accumulation: 4)
- Precision: 8-bit (bitsandbytes)
- Device: Google Colab (T4 16GB)
🔧 Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.2-1B", device_map="auto")
model = PeftModel.from_pretrained(base, "aptro/Llama-3.2-1B-samsun")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-1B")
License
This model follows the LLaMA 2 Community License Agreement.
- Task
- Summarization
- Library
- peft
- License
- llama2
- Created
- Apr 30, 2025
- Updated
- Apr 30, 2025