Downloads · 30 days
0
adamo1139/llama-3-70b-hesoyam-4-lora-rank16-adapter
llama-3-70b-hesoyam-4-lora-rank16-adapter is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
rank 16 lora of llama 3 70b 4bit bnb, trained locally on 2x 3090 Tis
Downloads · 30 days
0
Access
Public
Updated Dec 4, 2025
Repo size
6.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors4 GB · 64%
From the Hugging Face model README
rank 16 lora of llama 3 70b 4bit bnb, trained locally on 2x 3090 Tis
my first attempt at local multi-gpu QLoRA training where we train a model that does not fit on single GPU
it completed just 15% of the epoch on HESOYAM 0.4 dataset when I left it overnight, loss didn't go down much
