Downloads · 30 days
8
17% of all-time downloads
thesreedath/gemma-2-2b-legal-sft
gemma-2-2b-legal-sft is a machine learning model from thesreedath. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
Gemma 2 2B fine-tuned with QLoRA (4-bit NF4 base + LoRA adapters, r=16, alpha=32) on ~15k grounded legal Q&A pairs (context + question - answer-from-context, generated from a cleaned US case-law / SEC corpus). Adapter…
Downloads · 30 days
8
17% of all-time downloads
All-time downloads
46
Public
Parameters
2.6B
5.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors5.2 GB · 99%
From the Hugging Face model README
Gemma 2 2B fine-tuned with QLoRA (4-bit NF4 base + LoRA adapters, r=16, alpha=32) on ~15k grounded legal Q&A pairs (context + question -> answer-from-context, generated from a cleaned US case-law / SEC corpus). Adapters merged back into the base and saved here. Answers a question from a passage you provide.
Recipe: trl SFTTrainer, 3 epochs, lr 2e-4, batch 1 x grad-accum 16, bf16, gradient checkpointing. Built on Modal. Full pipeline + code: https://github.com/Vizuara-AI-Lab/slm-125m-from-scratch