allam-deepbac-adapter

---

language:

• ar

license: apache-2.0

library_name: peft

pipeline_tag: text-generation

base_model: ALLaM-AI/ALLaM-7B-Instruct-preview

tags:

• allam
• arabic
• qlora
• lora
• peft
• unsloth
• transformers
• trl
• education
• question-answering
• deepbac

---

DeepBac ALLaM QLoRA Adapter

This repository contains a QLoRA adapter obtained by fine-tuning ALLaM-7B-Instruct-preview for the DeepBac project.

The adapter is designed to improve Arabic educational question answering and student support for the Algerian Baccalaureate.

Note: This repository contains only the QLoRA adapter weights. The original ALLaM model is not included.

---

Model Information

---

Training Configuration

The adapter was trained using the following configuration:

Target modules:

• q_proj
• k_proj
• v_proj
• o_proj
• gate_proj
• up_proj
• down_proj

---

Intended Use

This adapter is intended for:

• Arabic educational assistants
• Educational question answering
• Student tutoring
• Personalized learning
• AI-assisted education

---

Loading the Adapter

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = AutoModelForCausalLM.from_pretrained(
    "ALLaM-AI/ALLaM-7B-Instruct-preview"
)

model = PeftModel.from_pretrained(
    base_model,
    "Belkacemdz/allam-deepbac-adapter"
)

tokenizer = AutoTokenizer.from_pretrained(
    "ALLaM-AI/ALLaM-7B-Instruct-preview"
)

---

Limitations

This adapter was fine-tuned specifically for educational applications.

Performance outside educational and Arabic question-answering tasks has not been evaluated.

---

License

This repository distributes only the QLoRA adapter.

The original ALLaM model remains subject to its own license and terms of use.

---

Author

Developed by Belkacem Achraf ZAGHEZ

Master's Student in Artificial Intelligence

University of Biskra, Algeria