Downloads · 30 days
7
7% of all-time downloads
shehryars715/finetuned-llama-3.2-3b
finetuned-llama-3.2-3b is a text generation model from shehryars715. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.2.
A LoRA fine-tuned version of Llama-3.2-3B-Instruct for agricultural question answering and crop advisory generation. This is the 3B parameter variant — more capable than the 1B version for complex agronomic reasoning…
Downloads · 30 days
7
7% of all-time downloads
All-time downloads
105
Public
Repo size
115 MB
Likes
0
Public
Click a slice to open those files.
.safetensors97.3 MB · 85%
From the Hugging Face model README
A LoRA fine-tuned version of Llama-3.2-3B-Instruct for agricultural question answering and crop advisory generation. This is the 3B parameter variant — more capable than the 1B version for complex agronomic reasoning while remaining lightweight enough for edge deployment.
Fine-tuned using Unsloth for fast, memory-efficient training on a single GPU.
Also available: 1B variant (lighter, faster inference)
| Field | Details |
|---|---|
| Base model | unsloth/Llama-3.2-3B-Instruct-bnb-4bit |
| Fine-tuning method | LoRA (Low-Rank Adaptation) via PEFT |
| Trainer | SFTTrainer (TRL) + Unsloth |
| Precision | 4-bit quantized (bitsandbytes) |
| Language | English |
| Domain | Agriculture / Crop Advisory |
| Developed by | shehryars715 |
Two datasets were mixed during fine-tuning:
crop, topic, question, answercrop_type, stage, NDVI, EVI, and generated Advisory| Parameter | Value |
|---|---|
| Training regime | fp16 mixed precision |
| LoRA rank (r) | 16 |
| LoRA alpha | 16 |
| LoRA dropout | 0 |
| Target modules | q, k, v, o, gate, up, down proj |
| Batch size | 2 (per device) |
| Gradient accumulation | 4 steps (effective batch = 8) |
| Epochs | 3 |
| Learning rate | 2e-4 |
| Optimizer | AdamW 8-bit |
| LR scheduler | Linear |
| Max seq length | 2048 |
| Hardware | Kaggle (NVIDIA T4 / P100, single GPU) |