Downloads · 30 days
6
5% of all-time downloads
ARIA_CODE_fr-instruct
willyninja30/ARIA_CODE_fr-instruct
ARIA_CODE_fr-instruct is a text generation model from willyninja30. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama2.
This model has been trained over 10 Millions tokens on a french language dataset structured with Alpaca style.
All-time downloads
121
Public
Repo size
78.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin78.7 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- llama2
- Access
- Public
- Created
- Aug 28, 2023
- Updated
- Aug 28, 2023
- SHA
- 3d956416
Datasets
Model card
From the Hugging Face model README
ARIA CODE FR Instruct is a finetuned model based on LLAMA CODE 34B INSTRUCT
This model has been trained over 10 Millions tokens on a french language dataset structured with Alpaca style.
GPU used for training : NVIDIA A100
Timing of training: 24H
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: True
- load_in_4bit: False
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: fp4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float32
Framework versions
- PEFT 0.6.0.dev0
- Task
- Text Generation
- Library
- peft
- License
- llama2
- Languages
- fr, en
- Created
- Aug 28, 2023
- Updated
- Aug 28, 2023