Downloads · 30 days
65
3% of all-time downloads
yaystevek/llama-3-8b-Instruct-OpenHermes-2.5-QLoRA-GGUF
llama-3-8b-Instruct-OpenHermes-2.5-QLoRA-GGUF is a text generation model from yaystevek. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT
Downloads · 30 days
65
3% of all-time downloads
All-time downloads
2.3K
Public
Repo size
21 GB
Likes
1
Public
Click a slice to open those files.
.gguf21 GB · 100%
From the Hugging Face model README
This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT
Llama 3 Instruct 8B 4-bit from unsloth, finetuned with the OpenHermes 2.5 dataset on my home PC on one 24GB 4090.
Special care was taken to preserve and reinforce proper eos token structure.
Chat with llama.cpp
llama.cpp/main -ngl 33 -c 0 --interactive-first --color -e --in-prefix '<|start_header_id|>user<|end_header_id|>\n\n' --in-suffix '<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n' -r '<|eot_id|>' -m ./llama-3-8b-Instruct-OpenHermes-2.5-QLoRA.Q4_K_M.gguf