Downloads · 30 days
3
1% of all-time downloads
mistral-7b-arc-qlora-exp7-3
llleb/mistral-7b-arc-qlora-exp7-3
mistral-7b-arc-qlora-exp7-3 is a text generation model from llleb. Use it when you need the model to write or continue text. It is set up for transformers.
This model is a QLoRA task-adapted Mistral-7B-v0.1 model for ARC-Challenge science multiple-choice QA.
All-time downloads
351
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Jul 2, 2026
- Updated
- Jul 2, 2026
- SHA
- 7015fb59
Try a prompt
Base models
Model card
From the Hugging Face model README
mistral-7b-arc-qlora-exp7-3
This model is a QLoRA task-adapted Mistral-7B-v0.1 model for ARC-Challenge science multiple-choice QA.
Training setup
- Base model:
mistralai/Mistral-7B-v0.1 - Method: 4-bit NF4 QLoRA + response-only loss
- Training data: ARC-Challenge train, ARC-Easy train subset, OpenBookQA train
- ARC-Easy ratio:
0.3 - Learning rate:
3e-05 - Epochs:
4 - LoRA r/alpha/dropout:
64/128/0.05
Evaluation
Evaluated with lm-evaluation-harness on arc_challenge using 25-shot prompting.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Jul 2, 2026
- Updated
- Jul 2, 2026