Downloads · 30 days
151
7% of all-time downloads
UIGEN-T2-7B-GGUF
Melvin56/UIGEN-T2-7B-GGUF
UIGEN-T2-7B-GGUF is a text generation model from Melvin56. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
2K
Public
Repo size
50.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf50.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Apr 30, 2025
- Updated
- Apr 30, 2025
- SHA
- 5183ac07
Try a prompt
Base models
Model card
From the Hugging Face model README
Melvin56/UIGEN-T2-7B-GGUF
Original Model : Tesslate/UIGEN-T2-7B
Llama.cpp build: 5219 (7d3af70b)
I used imatrix to create all these quants using this Dataset.
| CPU (AVX2) | CPU (ARM NEON) | Metal | cuBLAS | rocBLAS | SYCL | CLBlast | Vulkan | Kompute | |
|---|---|---|---|---|---|---|---|---|---|
| K-quants | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ 🐢5 | ✅ 🐢5 | ❌ |
| I-quants | ✅ 🐢4 | ✅ 🐢4 | ✅ 🐢4 | ✅ | ✅ | Partial¹ | ❌ | ❌ | ❌ |
✅: feature works
🚫: feature does not work
❓: unknown, please contribute if you can test it youself
🐢: feature is slow
¹: IQ3_S and IQ1_S, see #5886
²: Only with -ngl 0
³: Inference is 50% slower
⁴: Slower than K-quants of comparable size
⁵: Slower than cuBLAS/rocBLAS on similar cards
⁶: Only q8_0 and iq4_nl
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Apr 30, 2025
- Updated
- Apr 30, 2025