Downloads · 30 days
193
2% of all-time downloads
Seed-OSS-36B-Instruct-GGUF
yarikdevcom/Seed-OSS-36B-Instruct-GGUF
Seed-OSS-36B-Instruct-GGUF is a text generation model from yarikdevcom. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All credits to this PR, I just applied changes from one of the comments. Based on this PR https://github.com/ggml-org/llama.cpp/pull/15490
All-time downloads
12.6K
Public
Repo size
121 GB
Likes
18
Public
Repo makeup
Click a slice to open those files.
.gguf121 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Aug 22, 2025
- Updated
- Aug 23, 2025
- SHA
- cced0086
Try a prompt
Base models
Model card
From the Hugging Face model README
How to build:
sudo apt-get install pciutils build-essential cmake curl libcurl4-openssl-dev -y
git clone https://github.com/ggml-org/llama.cpp
cmake llama.cpp -B llama.cpp/build -DBUILD_SHARED_LIBS=OFF -DGGML_CUDA=ON -DLLAMA_CURL=ON
cmake --build llama.cpp/build --config Release -j --clean-first
How to run
./llama.cpp/build/bin/llama-server -hf yarikdevcom/Seed-OSS-36B-Instruct-GGUF:Q3_K_M --ctx-size 4096 --n-gpu-layers 99 --temp 1.1 --top-p 0.95 --port 8999 --host 0.0.0.0 --flash-attn --cache-type-k q8_0 --cache-type-v q8_0
All credits to this PR, I just applied changes from one of the comments. Based on this PR https://github.com/ggml-org/llama.cpp/pull/15490
- Task
- Text Generation
- License
- apache-2.0
- Created
- Aug 22, 2025
- Updated
- Aug 23, 2025