Downloads · 30 days
24
0% of all-time downloads
mistral-ko-OpenOrca-wiki-v1
shleeeee/mistral-ko-OpenOrca-wiki-v1
mistral-ko-OpenOrca-wiki-v1 is a text generation model from shleeeee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
It is a fine-tuned model using Korean in the mistral-7b model
All-time downloads
20.1K
Public
Parameters
7.2B
14.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Dec 5, 2023
- Updated
- Mar 8, 2024
- SHA
- 30534214
Model card
From the Hugging Face model README
Model Card for mistral-ko-OpenOrca-wiki-v1
It is a fine-tuned model using Korean in the mistral-7b model
Model Details
- Model Developers : shleeeee(Seunghyeon Lee), oopsung(Sungwoo Park)
- Repository : To be added
- Model Architecture : The shleeeee/mistral-ko-OpenOrca-wiki-v1 is is a fine-tuned version of the Mistral-7B-v0.1.
- Lora target modules : q_proj, k_proj, v_proj, o_proj,gate_proj
- train_batch : 4
- epochs : 2
Dataset
2000 ko-OpenOrca datasets
Prompt template: Mistral
<s>[INST]{['instruction']}[/INST]{['output']}</s>
Usage
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("shleeeee/mistral-ko-OpenOrca-wiki-v1")
model = AutoModelForCausalLM.from_pretrained("shleeeee/mistral-ko-OpenOrca-wiki-v1")
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="shleeeee/mistral-ko-OpenOrca-wiki-v1")
Evaluation
To be added
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- other
- Languages
- ko
- Created
- Dec 5, 2023
- Updated
- Mar 8, 2024