Downloads · 30 days
174
13% of all-time downloads
Hedi-Bk/gemma-4b-tunisian-law-gguf-2epochs
gemma-4b-tunisian-law-gguf-2epochs is a machine learning model from Hedi-Bk. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized GGUF versions of Gemma 4B fine-tuned for Tunisian law and legal instruction tasks.
Downloads · 30 days
174
13% of all-time downloads
All-time downloads
1.4K
Public
Repo size
20.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf20.1 GB · 100%
From the Hugging Face model README
Quantized GGUF versions of Gemma 4B fine-tuned for Tunisian law and legal instruction tasks.
This repository contains optimized GGUF models for local inference and deployment.
20.1075This repository includes multiple GGUF quantized versions:
Q4_K_MQ5_K_MQ8_0These quantizations are designed for different hardware configurations and memory usage.
Kaggle notebook used for training:
This model was trained using the QLoRA method for Tunisian legal tasks and instruction tuning.
The model achieved very strong results during testing with a final training loss of:
0.1075
Despite the low loss value, the model did not show problematic overfitting behavior during evaluation and generated high-quality legal responses.
./llama-cli \
-m gemma-4b-tunisian-law-Q4_K_M.gguf \
-p "Explique le droit tunisien du travail."
| Parameter | Value |
|---|---|
| Base Model | Gemma 4B |
| Fine-tuning Method | QLoRA |
| Epochs | 2 |
| Final Loss | 0.1075 |
| Format | GGUF |
| Quantizations | Q4_K_M / Q5_K_M / Q8_0 |
| Domain | Tunisian Law |
This model was trained using QLoRA and later converted into GGUF quantized formats.
Quantization may slightly affect generation quality depending on the selected format and hardware limitations.
For better quality and more stable generations, higher precision versions such as Q8_0 are recommended.
This project is intended for research and educational purposes only.
Generated legal content may contain inaccuracies and should not be considered professional legal advice.