Downloads · 30 days
0
tinyllama-alpaca-unsloth
sagar-kc7/tinyllama-alpaca-unsloth
tinyllama-alpaca-unsloth is a machine learning model from sagar-kc7. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a practice fine-tune of TinyLlama-1.1B on the Alpaca dataset using Unsloth. The goal of this project was not to achieve state-of-the-art performance but to understand the end-to-end fine-tuning pipeline using…
Access
Public
Updated May 16, 2026
Repo size
95 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors94.5 MB · 96%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 16, 2026
- Updated
- May 16, 2026
- SHA
- 79d1f2db
Base models
Model card
From the Hugging Face model README
TinyLlama Alpaca — Unsloth Fine-tuning Practice
Overview
This is a practice fine-tune of TinyLlama-1.1B on the Alpaca dataset using Unsloth. The goal of this project was not to achieve state-of-the-art performance but to understand the end-to-end fine-tuning pipeline using Unsloth, LoRA, and SFTTrainer on Google Colab.
What I learned
- Setting up Unsloth for memory-efficient fine-tuning on Colab T4 GPU
- Configuring LoRA parameters (rank, alpha, target modules)
- Formatting datasets using the Alpaca instruction template
- Using SFTTrainer from the trl library
- Saving and pushing LoRA adapters to HuggingFace Hub
Training Details
| Setting | Value |
|---|---|
| Base model | unsloth/tinyllama-bnb-4bit |
| Dataset |
Uploaded model
- Developed by: sagar-kc7
- License: apache-2.0
- Finetuned from model : unsloth/tinyllama-bnb-4bit
This llama model was trained 2x faster with Unsloth
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- May 16, 2026
- Updated
- May 16, 2026