Downloads · 30 days
0
kylebrussell/cap-sft-qwen3-lora-75k
cap-sft-qwen3-lora-75k is a machine learning model from kylebrussell. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
0
Access
Public
Updated Jul 24, 2025
Repo size
268 MB
Likes
0
Public
Click a slice to open those files.
.safetensors257 MB · 94%
From the Hugging Face model README
@ -0,0 +1,76 @@
This is a 75,000-sample supervised fine-tuned (SFT) version of Qwen3-14B trained on legal reasoning tasks from the Caselaw Access Project (CAP). The model uses LoRA (Low-Rank Adaptation) for parameter-efficient fine-tuning.
Overall Accuracy: 76.2% (61/80 samples across 5 legal tasks)
| Task | Accuracy | Status | Notes |
|---|---|---|---|
| Bluebook Citation | 80.0% (16/20) | ✅ PASS | Legal citation formatting |
| Holding Selection | 60.0% (12/20) | ❌ FAIL | Multiple choice questions |
| IRAC Summarization | 90.0% (18/20) | ✅ PASS | Case summarization |
| Case Retrieval | N/A | ⚠️ NO DATA | Missing evaluation samples |
| Entailment | 75.0% (15/20) | ❌ FAIL | Case relationship classification |
⚠️ Important Finding: This 75K model shows performance regression compared to the 30K model (81.3% → 76.2%), indicating overfitting. The 30K model should be preferred for downstream tasks.
Scaling Progression:
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("kylebrussell/cap-sft-qwen3-lora-75k")
model = AutoModelForCausalLM.from_pretrained("kylebrussell/cap-sft-qwen3-lora-75k")
# Generate legal text
prompt = "Complete this citation: Brown v. Board of Education, "
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=50)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
Trained on kylebrussell/cap-rlvr-sft - a multi-task legal reasoning dataset derived from the Caselaw Access Project.
Apache 2.0
@model{cap-sft-qwen3-lora-75k,
title={CAP-SFT-Qwen3-LoRA-75K: Legal Reasoning with Supervised Fine-Tuning},
author={CAP RLVR Project},
year={2025},
url={https://huggingface.co/kylebrussell/cap-sft-qwen3-lora-75k}
}
⚠️ Use the 30K model instead: Due to performance regression, we recommend using kylebrussell/cap-sft-qwen3-lora-30k for better legal reasoning performance.