mistral-7b-belebele-lora-hin-deva

xummer/mistral-7b-belebele-lora-hin-deva

mistral-7b-belebele-lora-hin-deva is a text generation model from xummer. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as other.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

33% of all-time downloads

All-time downloads

Public

Repo size

839 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors1 GB · 98%

At a glance

Task: Text Generation
Library: peft
License: other
Access: Public
Created: Mar 10, 2026
Updated: Mar 10, 2026
SHA: 579cc206

Try a prompt

Base models

mistralai/Mistral-7B-Instruct-v0.3

Model card

From the Hugging Face model README

belebele_hin_Deva

This model is a fine-tuned version of mistralai/Mistral-7B-Instruct-v0.3 on the belebele_hin_Deva_train dataset. It achieves the following results on the evaluation set:

Loss: 0.1654
Accuracy: 0.9618
Mcq Accuracy: 0.3614

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0002
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_steps: 0.1
num_epochs: 5.0

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Mcq Accuracy
0.1895	1.0811	40	0.1177	0.9559	0.2530
0.0503	2.1622	80	0.1357	0.9576	0.3012
0.0287	3.2432	120	0.1567	0.9586	0.3373
0.0129	4.3243	160	0.1613	0.9648	0.4096

Framework versions

PEFT 0.18.1
Transformers 5.2.0
Pytorch 2.10.0+cu128
Datasets 4.0.0
Tokenizers 0.22.2

Task: Text Generation
Library: peft
License: other
Created: Mar 10, 2026
Updated: Mar 10, 2026