Downloads · 30 days
122
15% of all-time downloads
wfwrigh/unity-coder-30b-GGUF
unity-coder-30b-GGUF is a machine learning model from wfwrigh. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized GGUF version of vishnuOI/unity-coder-30b for local inference.
Downloads · 30 days
122
15% of all-time downloads
All-time downloads
818
Public
Repo size
79.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf79.7 GB · 100%
From the Hugging Face model README
Quantized GGUF version of vishnuOI/unity-coder-30b for local inference.
Load directly in LM Studio, Ollama, or llama.cpp.
Needs testing and tweaks- as it stands, the q4_k_m version with base LM Studio settings performs worse than some newer models without Unity Lora training- consider it more of an experiment. If someone has better experience with the f16 or has a good configuration, let me know!