Downloads · 30 days
8
16% of all-time downloads
Chilliwiddit/MeQSum-llama3.1-8B-LoRA-pyTorch
MeQSum-llama3.1-8B-LoRA-pyTorch is a summarization model from Chilliwiddit. Use it when you need a shorter version of a longer text. It is set up for peft.
Basically used to summarize text from the MeQSum dataset
Downloads · 30 days
8
16% of all-time downloads
All-time downloads
49
Public
Repo size
353 MB
Likes
0
Public
Click a slice to open those files.
.safetensors336 MB · 95%
From the Hugging Face model README
Basically used to summarize text from the MeQSum dataset
I used the MeQSum dataset
Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
16 Mixed Precision
LR of 0.001
5 Epochs