Downloads · 30 days
10
19% of all-time downloads
TinyLlama-BobDylan-Lyric-Writer
culturebunker/TinyLlama-BobDylan-Lyric-Writer
TinyLlama-BobDylan-Lyric-Writer is a text generation model from culturebunker. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
A LoRA adapter fine-tuned to generate song lyrics in Bob Dylan's style.
All-time downloads
54
Public
Repo size
610 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors505 MB · 69%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 29, 2026
- Updated
- Apr 29, 2026
- SHA
- a37e3318
Try a prompt
Base models
Model card
From the Hugging Face model README
TinyLlama Bob Dylan Lyric Writer (LoRA)
A LoRA adapter fine-tuned to generate song lyrics in Bob Dylan's style.
Usage
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0")
model = PeftModel.from_pretrained(base, "your-username/TinyLlama-BobDylan-Lyric-Writer")
tokenizer = AutoTokenizer.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0")
prompt = "Write a song about rain and regret"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=300)
print(tokenizer.decode(outputs[0]))
Training Details
- Base Model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
- LoRA Rank: 32
- LoRA Alpha: 64
- Training Data: Bob Dylan songs dataset (342 examples)
- Format: Alpaca instruction-following
Results
| Metric | Value |
|---|---|
| Final Validation Loss | 3.91 |
| Final Perplexity | 49.89 |
| Total Training Steps | 158 |
Prompt Format
Write a song about [topic]
Example: "Write a song about loneliness and the open road"
- Task
- Text Generation
- Library
- peft
- Type
- llama
- License
- apache-2.0
- Created
- Apr 29, 2026
- Updated
- Apr 29, 2026