Downloads · 30 days
0
vietphuon/Llama-3.2-1B-Instruct-bnb-4bit-quizgen-241030-1
Llama-3.2-1B-Instruct-bnb-4bit-quizgen-241030-1 is a machine learning model from vietphuon. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
DATASET ------------------------------ - What's new?: Use the version 3.2 of dataset (Langfuse + AWS) that has better quality: - Remove all the 10, 15 question count, just focus on 5 question count - Fix all the Vietn…
Downloads · 30 days
0
Access
Public
Updated Oct 30, 2024
Repo size
22.6 MB
Likes
0
Public
Click a slice to open those files.
.safetensors22.6 MB · 71%
From the Hugging Face model README

Step Training Loss 1 1.216600 2 1.181100 3 1.236900 4 1.157100 5 1.184100 6 1.103500 7 1.150900 8 1.112900 9 1.074600 10 1.095700 11 0.966400 12 0.977000 13 1.004500 14 0.931500 15 0.869900 16 0.886300 17 0.900000 18 0.792500 19 0.814200 20 0.808900 21 0.815200 22 0.771100 23 0.800000 24 0.782500 25 0.772700 26 0.698300 27 0.759500 28 0.718500 29 0.711400 30 0.759400 31 0.717000 32 0.708700 33 0.726800 34 0.724500 35 0.747800 36 0.715600 37 0.708100 38 0.648300 39 0.677900 40 0.685600 41 0.726100 42 0.687300 43 0.663100 44 0.628600 45 0.663300 46 0.683500 47 0.673800 48 0.651100 49 0.683700 50 0.702400 51 0.664400 52 0.671800 53 0.673000 54 0.704000 55 0.621100 56 0.668200 57 0.686000 58 0.639500 59 0.665400 60 0.680900
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.