Downloads · 30 days
5
0% of all-time downloads
MaralGPT-Mistral-7B-v-0-1
MaralGPT/MaralGPT-Mistral-7B-v-0-1
MaralGPT-Mistral-7B-v-0-1 is a machine learning model from MaralGPT. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
MaralGPT is a Larage Language Model project launched in middle of the year 2023 by Iranian entrepreneur and engineer Muhammadreza Haghiri as an attempt to improve the AI for Persian language and also it is a part of M…
All-time downloads
1.3K
Public
Repo size
27.3 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin27.3 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Oct 11, 2023
- Updated
- Oct 11, 2023
- SHA
- 14b61a0d
Model card
From the Hugging Face model README
MaralGPT Mistral 7B version 0.1
MaralGPT is a Larage Language Model project launched in middle of the year 2023 by Iranian entrepreneur and engineer Muhammadreza Haghiri as an attempt to improve the AI for Persian language and also it is a part of Mann-E project.
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: gptq
- bits: 4
- tokenizer: None
- dataset: None
- group_size: 128
- damp_percent: 0.1
- desc_act: True
- sym: True
- true_sequential: True
- use_cuda_fp16: False
- model_seqlen: None
- block_name_to_quantize: None
- module_name_preceding_first_block: None
- batch_size: 1
- pad_token_id: None
- disable_exllama: False
- max_input_length: None
Framework versions
- PEFT 0.5.0
- Library
- peft
- Created
- Oct 11, 2023
- Updated
- Oct 11, 2023