Downloads · 30 days
12
26% of all-time downloads
apprentice-gemma4-e4b-lora-cuad-mi300x
singhabhishekkk/apprentice-gemma4-e4b-lora-cuad-mi300x
apprentice-gemma4-e4b-lora-cuad-mi300x is a machine learning model from singhabhishekkk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
Built with Gemma. bf16 LoRA (r=16, alpha 16, 3 epochs, TRL + PEFT) trained on an AMD MI300X with ROCm for the AMD Developer Hackathon: ACT II. 140 golden CUAD rows, evaluated on the same 60 held-out rows as the public…
All-time downloads
47
Public
Repo size
172 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors140 MB · 81%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026
- SHA
- df5a8b33
Base models
Datasets
Model card
From the Hugging Face model README
Apprentice Gemma 4 E4B LoRA, trained on AMD MI300X (contract clause extraction)
Built with Gemma. bf16 LoRA (r=16, alpha 16, 3 epochs, TRL + PEFT) trained on an AMD MI300X with ROCm for the AMD Developer Hackathon: ACT II. 140 golden CUAD rows, evaluated on the same 60 held-out rows as the public benchmark.
Results (measured 2026-07-10, field-level F1)
| System | Score |
|---|---|
| Gemma 4 E4B raw | 36.33 |
| Gemma 4 E4B fine-tuned (this adapter) | 61.67 |
| gpt-5.4-mini, GEPA-optimized (best published teacher) | 36.33 |
Train wall time 505.8 s (~8.4 GPU-minutes). Full run notebook and report: github.com/singhabhishekkk/apprentice-amd-hackathon
Caveat: 60-row held-out eval with exact-string field matching. Re-validate on your own data before production use.
- Library
- peft
- License
- apache-2.0
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026