Downloads · 30 days
62
6% of all-time downloads
kevembuvak/llama32-1b-qlora-finetome-exam-gguf
llama32-1b-qlora-finetome-exam-gguf is a machine learning model from kevembuvak. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a 1B parameter Llama 3.2 Instruct model fine-tuned using QLoRA in two stages:
Downloads · 30 days
62
6% of all-time downloads
All-time downloads
1.1K
Public
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.3 GB · 100%
From the Hugging Face model README
This repository contains a 1B parameter Llama 3.2 Instruct model fine-tuned using QLoRA in two stages:
| Property | Value |
|---|---|
| Base Model | meta-llama/Llama-3.2-1B-Instruct |
| Fine-tuning method | QLoRA (4-bit NF4 quantization) |
| Training Frameworks | transformers, trl, peft, bitsandbytes |
| GPU Used | NVIDIA RTX 4090 16 GB |
| LoRA Config | r=16, alpha=32, dropout=0.05 |
| Context length | 4096 |
| Export Format | GGUF Q4_K_M and Q8_0 |
| Intended Use | ID2223 exam preparation, ML/LLM explanations |
This model was trained in two QLoRA stages.
Dataset: mlabonne/FineTome-100k (sampled 40k)
tokenizer.apply_chat_template)This produced the adapter: llama32-1b-qlora-finetome.
Dataset: kevembuvak/id2223_exam_prep
Final training loss: approx. 0.079
Companion Hugging Face Space - Iris [https://huggingface.co/spaces/kevembuvak/iris]
Training Code (GitHub) [https://github.com/keremburakyilmaz/PEFT-of-LLM]
Intended For:
Not Suitable For:
Meta AI for Llama 3.2
FineTome dataset (mlabonne/FineTome-100k)
Hugging Face (transformers, trl, peft)