Downloads · 30 days
35
0% of all-time downloads
Mistral-Nemo-Instruct-2407-gptq-4bit
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Mistral-Nemo-Instruct-2407-gptq-4bit is a text generation model from ModelCloud. Use it when you need the model to write or continue text. It is set up for transformers.
This model has been quantized using GPTQModel.
All-time downloads
103K
Public
Parameters
12.2B
8.4 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 100%
Parameter types
How the weights are stored.
I3210.9B · 89%
Try a prompt
Model card
From the Hugging Face model README
This model has been quantized using GPTQModel.
- bits: 4
- group_size: 128
- desc_act: true
- static_groups: false
- sym: true
- lm_head: false
- damp_percent: 0.01
- true_sequential: true
- model_name_or_path: ""
- model_file_base_name: "model"
- quant_method: "gptq"
- checkpoint_format: "gptq"
- meta：
- quantizer: "gptqmodel:0.9.9-dev0"
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Jul 19, 2024
- Updated
- Jul 23, 2024