Downloads · 30 days
20
4% of all-time downloads
TaQuants/Tema_Q-X5-Thinking-TaQuants-GGUF
Tema_Q-X5-Thinking-TaQuants-GGUF is a text generation model from TaQuants. Use it when you need the model to write or continue text.
Downloads · 30 days
20
4% of all-time downloads
All-time downloads
519
Public
Repo size
23.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf23.6 GB · 100%
From the Hugging Face model README
The Repository
Technical Report
The Tema_Q development team, team zenei, has developed a new importance matrix method called TaQuants (Tensor-aware Adaptive Quantization).
This model is a TaQuants version of temaq-org/Tema_Q-X5-Thinking created with TaQuants v3.0.
For short-term generation, both the TaIQ2 and TaIQ3 models achieve higher accuracy than 3 bits. However, all models experience collapse during long-term text generation. Therefore, only 2 bits of GGUF are provided.