Downloads · 30 days
8
0% of all-time downloads
barc0/induction-40k-50seeds-gpt4omini-llama3.1-8b-instruct-lora64_lr2e-4_epoch3
induction-40k-50seeds-gpt4omini-llama3.1-8b-instruct-lora64_lr2e-4_epoch3 is a machine learning model from barc0. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as llama3.1.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
8
0% of all-time downloads
All-time downloads
3.3K
Public
Repo size
1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors336 MB · 97%
From the Hugging Face model README
This model is a fine-tuned version of meta-llama/Meta-Llama-3.1-8B-Instruct on the barc0/induction_20k_gpt4o-mini_generated_problems_seed50.jsonl_messages_format_0.3 and the barc0/induction_20k_gpt4o-mini_generated_problems_seed50_part2_messages_format_0.3 datasets. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 0.3374 | 0.9983 | 300 | 0.3371 |
| 0.3012 | 2.0 | 601 | 0.3222 |
| 0.2901 | 2.9950 | 900 | 0.3195 |