Downloads · 30 days
5
7% of all-time downloads
Dongjin1203/Llama-3-Open-Ko-8B-GGUF
Llama-3-Open-Ko-8B-GGUF is a machine learning model from Dongjin1203. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
readmecontent = """--- language: - ko - en license: llama3 tags: - llama-cpp - gguf basemodel: beomi/Llama-3-Open-Ko-8B ---
Downloads · 30 days
5
7% of all-time downloads
All-time downloads
74
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
readme_content = """--- language:
Base model을 GGUF Q4_K_M으로 양자화한 버전입니다.
from llama_cpp import Llama
llm = Llama(
model_path="Llama-3-Open-Ko-8B-Q4_K_M.gguf",
n_ctx=2048,
n_gpu_layers=0
)
response = llm("안녕하세요")
print(response)
"""
upload_file( path_or_fileobj=readme_content.encode(), path_in_repo="README.md", repo_id="Dongjin1203/Llama-3-Open-Ko-8B-GGUF", repo_type="model" )