Downloads · 30 days
0
mistral-7b-ko-v1
shleeeee/mistral-7b-ko-v1
mistral-7b-ko-v1 is a text generation model from shleeeee. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as other.
It is a fine-tuned model using Korean in the mistral-7b model
Access
Public
Updated Mar 8, 2024
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Dec 27, 2023
- Updated
- Mar 8, 2024
- SHA
- 7b1e47f6
Model card
From the Hugging Face model README
Model Card for mistral-7b-ko-v1
It is a fine-tuned model using Korean in the mistral-7b model
Model Details
- Model Developers : shleeeee(Seunghyeon Lee) , oopsung(Sungwoo Park)
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: float16
Framework versions
- PEFT 0.5.0.dev0
- Task
- Text Generation
- Library
- peft
- Type
- mistral
- License
- other
- Languages
- ko
- Created
- Dec 27, 2023
- Updated
- Mar 8, 2024