Downloads · 30 days
72
8% of all-time downloads
richardyoung/uigen-x-30b-moe
uigen-x-30b-moe is a text generation model from richardyoung. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
Quantized builds of the UIGEN-X 30B Mixture-of-Experts coding assistant for local inference with Ollama / llama.cpp runtimes. Each variant ships with the Modelfile exported from the Ollama registry plus the correspond…
Downloads · 30 days
72
8% of all-time downloads
All-time downloads
944
Public
Repo size
122 GB
Likes
0
Public
Click a slice to open those files.
.gguf122 GB · 100%
From the Hugging Face model README
Quantized builds of the UIGEN-X 30B Mixture-of-Experts coding assistant for local inference with Ollama / llama.cpp runtimes. Each variant ships with the Modelfile exported from the Ollama registry plus the corresponding GGUF binary.
smirki/UIGEN-X-30B-MoE-merged-checkpoint-200| Variant | Size | Blob |
|---|---|---|
q2_k | 10.49 GB | sha256-89dc7fdb0a4a30a6bd4e8a611db45fd821ccce4748d5bda1fc5151b5be0fc0fd |
q3_k_s | 12.38 GB | sha256-5dc18116ed7f2c98b96361b4a12e8b43fb4e75ee3dc162ba73a74226a3621a3c |
Q4_K_M | 17.28 GB | sha256-4c641495ea35d559011305746eeda3b9cc1c3ef6cabce16c2c260962715957e5 |
Q5_K_M | 20.23 GB | sha256-3848f1b66aeee5b454ad3c3d6133da2723e84e7cfa0bee9e67d81639cdbd9b4d |
Q6_K | 23.37 GB | sha256-4a08030b66cb100eff2c183500b7c96ef44e3f4816911d32fe55a1e2a4aa1d47 |
Q8_0 | 30.25 GB | sha256-fc84a665b1889d7c6bed55b2b5dedee464ba80400bf1fbd43164b48eb219e2a7 |
Example with the Q5_K_M quantization:
ollama create uigen-x-30b-moe-q5-k-m -f modelfiles/uigen-x-30b-moe--Q5_K_M.Modelfile
ollama run uigen-x-30b-moe-q5-k-m
Swap Q5_K_M for any other variant listed above.
Originally published on my Ollama profile: https://ollama.com/richardyoung/uigen-x-30b-moe
Built & maintained by Richard Young · DeepNeuro