Downloads · 30 days
6
12% of all-time downloads
Ibrahimgvn/testedio-koc-8b
testedio-koc-8b is a machine learning model from Ibrahimgvn. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
Baz model: meta-llama/Meta-Llama-3.1-8B-Instruct Fine-tune: Unsloth QLoRA, GGUF Q4KM
Downloads · 30 days
6
12% of all-time downloads
All-time downloads
49
Public
Repo size
4.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.9 GB · 100%
From the Hugging Face model README
Baz model: meta-llama/Meta-Llama-3.1-8B-Instruct
Fine-tune: Unsloth QLoRA, GGUF Q4_K_M
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="Ibrahimgvn/testedio-koc-8b",
filename="*.gguf",
n_ctx=2048,
n_gpu_layers=0,
)