Downloads · 30 days
342
8% of all-time downloads
RDson/Seed-OSS-36B-Instruct-GGUF
Seed-OSS-36B-Instruct-GGUF is a text generation model from RDson. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Created using the fork pwilkin/llama.cpp, commit 8f64302. The main repo now supports the models! The quantization process is still the same, no re-making of the models is needed.
Downloads · 30 days
342
8% of all-time downloads
All-time downloads
4.4K
Public
Repo size
288 GB
Likes
1
Public
Click a slice to open those files.
.gguf288 GB · 100%
From the Hugging Face model README
Created using the fork pwilkin/llama.cpp, commit 8f64302. The main repo now supports the models! The quantization process is still the same, no re-making of the models is needed.
This is still in development, expect issues.
Settings
- temp: 1.1
- top-p: 0.95
The IQ models are made using bartowski1182/calibration_datav3.txt.