Downloads · 30 days
8
1% of all-time downloads
squarelike/Gugugo-koen-7B-V1.1-AWQ
Gugugo-koen-7B-V1.1-AWQ is a translation model from squarelike. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as apache-2.0.
Detail repo: https://github.com/jwj7140/Gugugo
Downloads · 30 days
8
1% of all-time downloads
All-time downloads
1.5K
Public
Parameters
1.2B
8.2 GB on disk
Likes
2
Public
Click a slice to open those files.
.bin4.1 GB · 50%
How the weights are stored.
I32816M · 65%
From the Hugging Face model README
Detail repo: https://github.com/jwj7140/Gugugo

Base Model: Llama-2-ko-7b
Training Dataset: sharegpt_deepl_ko_translation.
I trained with 1x A6000 GPUs for 90 hours.
KO->EN
### 한국어: {sentence}</끝>
### 영어:
EN->KO
### 영어: {sentence}</끝>
### 한국어:
from vllm import LLM, SamplingParams
def make_prompt(data):
prompts = []
for line in data:
prompts.append(f"### 영어: {line}</끝>\n### 한국어:")
return prompts
texts = [
"Hello world!",
"Nice to meet you!"
]
prompts = make_prompt(texts)
sampling_params = SamplingParams(temperature=0.01, stop=["</끝>"], max_tokens=700)
llm = LLM(model="squarelike/Gugugo-koen-7B-V1.1-AWQ", quantization="awq", dtype="half")
outputs = llm.generate(prompts, sampling_params)
# Print the outputs.
for output in outputs:
print(output.outputs[0].text)