Downloads · 30 days
10
2% of all-time downloads
Carnice-27b-IQ3_M
Mikerhinos/Carnice-27b-IQ3_M
Carnice-27b-IQ3_M is a machine learning model from Mikerhinos. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantization of Carnice-27b based on Qwen3.5-27B.
All-time downloads
521
Public
Repo size
13.7 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf13.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 10, 2026
- Updated
- Apr 10, 2026
- SHA
- 784f4e09
Base models
Model card
From the Hugging Face model README
Carnice-27b-GGUF
Quantization of Carnice-27b based on Qwen3.5-27B.
Available Files
- Carnice-27b-IQ3_M.gguf ← Recommended for 16GB VRAM
IQ3_M Details
- Quantization type: IQ3_M (Intelligence Quantization 3-bit Medium)
- Imatrix: Yes (calibrated on 496 chunks)
- leave-output-tensor: Yes (
output.weightkept in Q8_0) - token-embedding-type:
q8_0 - File size: ~13.7 GB
- Target use case: High context lengths with
turbo3_tcq/polaron 16GB GPUs
Best used with:
--ctx-size 90k(you should be able to go up to 100k, I personnally use 98k)-ctk turbo3_tcq -ctv turbo3_tcq
Why this quantization?
This IQ3_M was created from the original Q8_0 using an importance matrix for better quality/performance tradeoff. It offers a good balance between size, quality, and context capability on 16GB cards.
Original model: kai-os/Carnice-27b
Original GGUF collection: kai-os/Carnice-27b-GGUF
- License
- apache-2.0
- Created
- Apr 10, 2026
- Updated
- Apr 10, 2026