Downloads · 30 days
63
31% of all-time downloads
baa-ai/paddock-reader-9b-gguf
paddock-reader-9b-gguf is a machine learning model from baa-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Default grounded-answering reader for the baa.ai Paddock console. 9B parameters, 8/4-bit mixed quantization, GGUF (llama.cpp — Metal, CUDA, or CPU). ~6.8 GB; recommend =16 GB RAM (CPU) or any =8 GB GPU. Context: run w…
Downloads · 30 days
63
31% of all-time downloads
All-time downloads
203
Public
Repo size
7.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf7.3 GB · 100%
From the Hugging Face model README
Default grounded-answering reader for the baa.ai Paddock console. 9B parameters, 8/4-bit mixed quantization, GGUF (llama.cpp — Metal, CUDA, or CPU). ~6.8 GB; recommend >=16 GB RAM (CPU) or any >=8 GB GPU. Context: run with n_ctx 4096-8192. Downloaded automatically by the Paddock installer and container; verify against SHA256SUMS.