Downloads · 30 days
75
2% of all-time downloads
RedHatAI_Qwen3.6-35B-A3B-NVFP4-GGUF
eepos/RedHatAI_Qwen3.6-35B-A3B-NVFP4-GGUF
RedHatAI_Qwen3.6-35B-A3B-NVFP4-GGUF is a machine learning model from eepos. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXPERIMENTAL conversion by a total noob.
All-time downloads
3.3K
Public
Repo size
22.5 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf22.5 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 18, 2026
- Updated
- Apr 23, 2026
- SHA
- 970f14b2
Base models
Model card
From the Hugging Face model README
EXPERIMENTAL conversion by a total noob.
Converted with https://github.com/ggml-org/llama.cpp/pull/21095
Produces coherent text but I won't guarantee everything went error free.
PS. I mainly did this conversion for performance testing on a 5090 and PR 21896. I found out that the increase to prompt processing speed from NVFP4 acceleration is smaller with this MoE model than it is with dense models such as Qwen 3.5 27B or Gemma 4 31B.
- License
- apache-2.0
- Created
- Apr 18, 2026
- Updated
- Apr 23, 2026