Downloads · 30 days
4
15% of all-time downloads
AlinaKl/ljb-llama3.1-8b-syntax-mix
ljb-llama3.1-8b-syntax-mix is a machine learning model from AlinaKl. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A LoRA adapter (rank 16, alpha 32) for meta-llama/Llama-3.1-8B, trained for 1 epoch using SFT on a 10% stratified sample of the Tulu-SFT-Mix. The dataset originally contains a 10:90 safety/non-safety ratio which is re…
Downloads · 30 days
4
15% of all-time downloads
All-time downloads
27
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
A LoRA adapter (rank 16, alpha 32) for meta-llama/Llama-3.1-8B, trained for 1 epoch using SFT on a 10% stratified sample of the Tulu-SFT-Mix. The dataset originally contains a 10:90 safety/non-safety ratio which is reduced to 1:99 to mitigate over-refusal. The used safety samples are taken from the original dataset and synthetically paraphrased to cover diverse syntax forms.
This model corresponds to the SYNTAX-MIX run from our paper "Mood Matters: How Syntactic Sensitivity Undermines Safety Alignment" (2026).