SiamGPT-32B-gguf

sthaps/SiamGPT-32B-gguf

SiamGPT-32B-gguf is a text generation model from sthaps. Use it when you need the model to write or continue text.

This repository contains GGUF weights for siamaids/SiamGPT-32B.

Downloads · 30 days

103

16% of all-time downloads

All-time downloads

657

Public

Repo size

89.9 GB

Likes

Public

Repo makeup

Click a slice to open those files.

.gguf89.9 GB · 100%

From the Hugging Face model README

This repository contains GGUF weights for siamaids/SiamGPT-32B.

For a convenient overview and download list, visit our model page.

If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.

./llama-cli -m SiamGPT-32B-q4_k_m.gguf -p "Hello!"

(sorted by size, not necessarily quality)

Link	Type	Size/GB	Notes
GGUF	q2_k	11.50	very low quality, for testing
GGUF	q3_k_m	14.87
GGUF	q4_0	17.36
GGUF	q4_k_m	18.40	recommended, good balance
GGUF	q5_k_m	21.62

Special thanks to the llama.cpp team for their amazing work.