Downloads · 30 days
3
14% of all-time downloads
gemma-2b-legal-qa
Sarath569/gemma-2b-legal-qa
gemma-2b-legal-qa is a machine learning model from Sarath569. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as gemma.
A QLoRA closed-book QA adapter on google/gemma-2-2b (2.6B) for legal / financial text, trained on a teacher-distilled, LLM-judged, deduplicated QA dataset built from US case law + SEC filings. Companion to the from-sc…
All-time downloads
21
Public
Repo size
117 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors83.1 MB · 71%
At a glance
- Library
- peft
- License
- gemma
- Access
- Public
- Created
- Jul 25, 2026
- Updated
- Jul 25, 2026
- SHA
- 0cb6197b
Base models
Model card
From the Hugging Face model README
Sarath569/gemma-2b-legal-qa
A QLoRA closed-book QA adapter on google/gemma-2-2b (2.6B) for legal / financial text,
trained on a teacher-distilled, LLM-judged, deduplicated QA dataset built from US case law +
SEC filings. Companion to the from-scratch 125M models (Sarath569/slm-125m-legal-*).
- Trainable (LoRA) params: 20,766,720 of ~2.6B (1.28%).
- Train examples: 9,000 (3 epochs, 1,631,097 tokens processed).
- Final train loss ~1.1329. QLoRA cost ~$1.32.
Prompt
Uses Gemma's chat template: the question in the user turn; the model answers from parametric memory.
Limitations
2.6B model, QLoRA-tuned on a small synthetic set — research demo, not legal/financial advice.
- Library
- peft
- License
- gemma
- Languages
- en
- Created
- Jul 25, 2026
- Updated
- Jul 25, 2026