Downloads · 30 days
0
Chilliwiddit/AsclepiusLM
AsclepiusLM is a summarization model from Chilliwiddit. Use it when you need a shorter version of a longer text. It is set up for peft.
Basically paired the unsloth/Meta-Llama-3.1-8B-bnb-4bit base model with the fine-tuned Chilliwiddit/Openi-llama3.1-8B-WeightedLoss-small2 adapter.
Downloads · 30 days
0
Access
Public
Updated Mar 10, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 60%
From the Hugging Face model README
Basically paired the unsloth/Meta-Llama-3.1-8B-bnb-4bit base model with the fine-tuned Chilliwiddit/Openi-llama3.1-8B-WeightedLoss-small2 adapter.
I used the Open-i dataset
Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
16 Mixed Precision
LR of 0.0-1
5 Epochs
lambda medical weight of 20 and lambda negation weight of 20
Used 2nd iteration of summary medical concepts file