Downloads · 30 days
19
3% of all-time downloads
HyperCLOVAX-SEED-Text-Instruct-1.5B-gguf-bf16
sorryhyun/HyperCLOVAX-SEED-Text-Instruct-1.5B-gguf-bf16
HyperCLOVAX-SEED-Text-Instruct-1.5B-gguf-bf16 is a machine learning model from sorryhyun. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
551
Public
Repo size
3.2 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf3.2 GB · 100%
At a glance
- Access
- Public
- Created
- Apr 25, 2025
- Updated
- Apr 25, 2025
- SHA
- e3208b6e
Base models
Model card
From the Hugging Face model README
llama.cpp를 사용해 gguf로 변환했습니다.
from llama_cpp import Llama
llm = Llama(
model_path="HyperCLOVAX-SEED-Text-Instruct-1.5B-gguf-bf16.gguf",
n_gpu_layers=-1,
main_gpu=0,
n_ctx=2048
)
output = llm(
"재미있는 이야기 하나 만들어줘. 1000자 이상이어야 해. 시작:", # Prompt
max_tokens=2048,
echo=True,
)
print(output)
geforce 3070 RTX로 테스트했으며, 성능은 다음과 같습니다.
bf16, peak: 4GB
llama_perf_context_print: load time = 210.50 ms
llama_perf_context_print: prompt eval time = 210.42 ms / 19 tokens ( 11.07 ms per token, 90.30 tokens per second)
llama_perf_context_print: eval time = 17923.17 ms / 2028 runs ( 8.84 ms per token, 113.15 tokens per second)
llama_perf_context_print: total time = 21307.79 ms / 2047 tokens
- Languages
- ko, en
- Created
- Apr 25, 2025
- Updated
- Apr 25, 2025