Downloads · 30 days
21
42% of all-time downloads
RichardErkhov/barc0_-_llama3.2-1b-instruct-fft-transduction-engineer_lr1e-5_epoch4-awq
barc0_-_llama3.2-1b-instruct-fft-transduction-engineer_lr1e-5_epoch4-awq is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
21
42% of all-time downloads
All-time downloads
50
Public
Parameters
1.2B
1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1 GB · 98%
How the weights are stored.
I32973M · 79%
From the Hugging Face model README
Quantization made by Richard Erkhov.
llama3.2-1b-instruct-fft-transduction-engineer_lr1e-5_epoch4 - AWQ
library_name: transformers license: llama3.2 base_model: meta-llama/Llama-3.2-1B-Instruct tags:
This model is a fine-tuned version of meta-llama/Llama-3.2-1B-Instruct on the barc0/transduction_angmented_100k-gpt4-description-gpt4omini-code_generated_problems, the barc0/transduction_angmented_100k_gpt4o-mini_generated_problems and the barc0/transduction_rearc_dataset_400k datasets. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 0.0618 | 1.0 | 1126 | 0.0657 |
| 0.0504 | 2.0 | 2252 | 0.0494 |
| 0.0363 | 3.0 | 3378 | 0.0418 |
| 0.0238 | 4.0 | 4504 | 0.0409 |