Downloads · 30 days
0
mistral-qlora-banking
iamnotpalak/mistral-qlora-banking
mistral-qlora-banking is a text generation model from iamnotpalak. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a fine-tuned version of Mistral-7B using QLoRA for domain-specific conversational tasks in retail banking.
Access
Public
Updated Apr 8, 2026
Repo size
1.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026
- SHA
- 68299675
Try a prompt
Base models
Model card
From the Hugging Face model README
Mistral-7B QLoRA Fine-Tuned (Retail Banking Chatbot)
Overview
This model is a fine-tuned version of Mistral-7B using QLoRA for domain-specific conversational tasks in retail banking.
Model Details
- Base Model: mistralai/Mistral-7B
- Fine-tuning Method: QLoRA (4-bit NF4 quantization)
- Framework: Hugging Face Transformers + PEFT
- Task: Banking chatbot / conversational QA
Training
- Dataset: Custom retail banking dataset
- Approach: Parameter-Efficient Fine-Tuning (PEFT)
- Objective: Improve domain-specific response generation
Evaluation
- ROUGE-1: 0.47
- ROUGE-L: 0.34
- BLEU: 0.11
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
model_id = "iamnotpalak/mistral-qlora-banking"
tokenizer = AutoTokenizer.from_pretrained(model_id)
base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B")
model = PeftModel.from_pretrained(base_model, model_id)
- Task
- Text Generation
- Library
- transformers
- Languages
- en
- Created
- Apr 8, 2026
- Updated
- Apr 8, 2026