Downloads · 30 days
3
10% of all-time downloads
tnm-14b-chat-exl2-4bit
mendrikarama/tnm-14b-chat-exl2-4bit
tnm-14b-chat-exl2-4bit is a machine learning model from mendrikarama. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is the 4.0-bit quantized version of the TNM-14B chat model using ExLlama2 quantization.
All-time downloads
29
Public
Repo size
18.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors18.4 GB · 100%
At a glance
- Model type
- qwen2
- Access
- Public
- Created
- Oct 28, 2024
- Updated
- Oct 28, 2024
- SHA
- f337e1dd
Model card
From the Hugging Face model README
4.0-bit Quantized TNM-14B Chat Model
This is the 4.0-bit quantized version of the TNM-14B chat model using ExLlama2 quantization.
Model Details
- Original Model: TNM-14B Chat
- Quantization: 4.0 bits per weight
- Repository: https://huggingface.co/mendrikarama/tnm-14b-chat-exl2-4bit
- Type
- qwen2
- Created
- Oct 28, 2024
- Updated
- Oct 28, 2024