Downloads · 30 days
17
27% of all-time downloads
Qwen2-7B-Instruct-4bit-quantized
subhajit17/Qwen2-7B-Instruct-4bit-quantized
Qwen2-7B-Instruct-4bit-quantized is a text generation model from subhajit17. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This repo contains 4-bit quantized (using bitsandbytes) model of Qwen2-7B-Instruct
All-time downloads
63
Public
Parameters
7.8B
5.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.5 GB · 100%
Parameter types
How the weights are stored.
U86.7B · 86%
Try a prompt
Model card
From the Hugging Face model README
Model Card for subhajit17/Qwen2-7B-Instruct-4bit-quantized
<!-- Provide a quick summary of what the model is/does. -->This repo contains 4-bit quantized (using bitsandbytes) model of Qwen2-7B-Instruct
Model Details
- Model creator: Qwen2
- Original model: Qwen2-7B-Instruct
How to Get Started with the Model
Use the code below to get started with the model.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- mit
- Created
- Jun 7, 2024
- Updated
- Jun 7, 2024