Downloads · 30 days
99
25% of all-time downloads
goon-cave-7b-instruct-bnb-4bit
SADASDASDSASADSADSADSAD/goon-cave-7b-instruct-bnb-4bit
goon-cave-7b-instruct-bnb-4bit is a text generation model from SADASDASDSASADSADSADSAD. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
A compact Llama-architecture model in GGUF format, exported as I8 tensors for straightforward inspection and inference.
All-time downloads
402
Public
Parameters
101M
105 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors50.3 MB · 95%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jul 22, 2026
- Updated
- Jul 23, 2026
- SHA
- 5b493895
Try a prompt
Model card
From the Hugging Face model README
SADASDASDSASADSADSADSAD/goon-cave-7b-instruct-bnb-4bit
A compact Llama-architecture model in GGUF format, exported as I8 tensors for straightforward inspection and inference.
Model details
| Property | Value |
|---|---|
| Architecture | Llama |
| Tensor precision | I8 |
| Format | GGUF v3 |
Architecture parameters (context length, embedding length, block count, etc.) are declared in the GGUF metadata and rendered by the HF viewer.
Usage
llama.cpp
llama-cli -m goon-cave-7b-instruct-v1.0.gguf -p "Your prompt here" -n 256
Python (llama-cpp-python)
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="SADASDASDSASADSADSADSAD/goon-cave-7b-instruct-bnb-4bit",
filename="goon-cave-7b-instruct-v1.0.gguf",
)
output = llm("Q: What is the meaning of life? A:", max_tokens=64)
print(output["choices"][0]["text"])
Download
hf download SADASDASDSASADSADSADSAD/goon-cave-7b-instruct-bnb-4bit \
--include "*.gguf" --local-dir ./
- Task
- Text Generation
- Library
- gguf
- Type
- llama
- License
- apache-2.0
- Created
- Jul 22, 2026
- Updated
- Jul 23, 2026