Downloads · 30 days
9
4% of all-time downloads
ARIA-7B-V3-mistral-french
Faradaylab/ARIA-7B-V3-mistral-french
ARIA-7B-V3-mistral-french is a machine learning model from Faradaylab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
We decided to release an ARIA 7B model trained with mistral 7B instruct as base model. We adressed the language challenge with a dataset focused on french language.
All-time downloads
224
Public
Repo size
54.6 MB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin27.3 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Oct 2, 2023
- Updated
- Oct 3, 2023
- SHA
- bb7b3ba5
Model card
From the Hugging Face model README
Training procedure
We decided to release an ARIA 7B model trained with mistral 7B instruct as base model. We adressed the language challenge with a dataset focused on french language.
The finetuning has been done with Nvidia GPUs.
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
Framework versions
- PEFT 0.6.0.dev0
- Library
- peft
- Created
- Oct 2, 2023
- Updated
- Oct 3, 2023