Downloads · 30 days
28
2% of all-time downloads
daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-gguf-v0.1
Phi-3-medium-4k-instruct-ko-poc-gguf-v0.1 is a text generation model from daekeun-ml. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model converted the daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-v0.1 to gguf 4-bit format.
Downloads · 30 days
28
2% of all-time downloads
All-time downloads
1.2K
Public
Repo size
8.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf8.8 GB · 100%
From the Hugging Face model README
This model converted the daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-v0.1 to gguf 4-bit format.
For detailed instructions, please refer to Microsoft's official repo.
The dataset used for training is as follows. To prevent catastrophic forgetting, I included non-Korean corpus as training data. Note that we did not use all of the data, but only sampled some of it. Korean textbooks were converted to Q&A format. The Guanaco dataset has been reformatted to fit the multiturn format like <|user|>\n{Q1}<|end|>\n<|assistant|>\n{A1}<|end|>\n<|user|>\n{Q2}<|end|>\n<|assistant|>\n{A2}<|end|>.
curl -fsSL https://ollama.com/install.sh | sh
huggingface-cli download daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-gguf-v0.1 Modelfile_q4 --local-dir /path/to/your/local/dir
ollama create phi3-ko -f Modelfile_q4
ollama run phi3-ko What is Machine Learning?
apache 2.0; The license of phi-3 is MIT, but I considered the licensing of the dataset and library used for training.
This model was created as a personal experiment, unrelated to the organization I work for. The model may not operate correctly because separate verification was not performed. Please be careful unless it is for personal experimentation or PoC (Proof of Concept)!