Downloads · 30 days
2
9% of all-time downloads
wkshin89_-_Yi-Ko-6B-Instruct-v1.1-4bits
RichardErkhov/wkshin89_-_Yi-Ko-6B-Instruct-v1.1-4bits
wkshin89_-_Yi-Ko-6B-Instruct-v1.1-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
23
Public
Parameters
6.3B
4.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.4 GB · 100%
Parameter types
How the weights are stored.
U85.5B · 88%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Yi-Ko-6B-Instruct-v1.1 - bnb 4bits
- Model creator: https://huggingface.co/wkshin89/
- Original model: https://huggingface.co/wkshin89/Yi-Ko-6B-Instruct-v1.1/
Original model description:
license: cc-by-nc-4.0 datasets:
- kyujinpy/KOR-OpenOrca-Platypus-v3
- beomi/KoAlpaca-v1.1a
- maywell/ko_wikidata_QA language:
- ko base_model: beomi/Yi-Ko-6B
Yi-Ko-6B-Instruct-v1.1
Model Details
Base Model
Training Dataset
- kyujinpy/KOR-OpenOrca-Platypus-v3 🙇
- beomi/KoAlpaca-v1.1a 🙇
- maywell/ko_wikidata_QA 🙇
- AIHub 데이터 활용
Instruction Format
### User:
{instruction}
### Assistant:
{response}
Loading the Model
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("wkshin89/Yi-Ko-6B-Instruct-v1.1")
model = AutoModelForCausalLM.from_pretrained(
"wkshin89/Yi-Ko-6B-Instruct-v1.1",
device_map="auto",
torch_dtype=torch.bfloat16,
)
- Type
- llama
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024