Downloads · 30 days
5
3% of all-time downloads
quantized_qwen_model
ShubhaLabs/quantized_qwen_model
quantized_qwen_model is a machine learning model from ShubhaLabs. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a quantized version of the Qwen model for causal language modeling.
All-time downloads
189
Public
Repo size
1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth1 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024
- SHA
- 68c4b22f
Base models
Model card
From the Hugging Face model README
Quantized Qwen Model
This repository contains a quantized version of the Qwen model for causal language modeling.
Model Details
- Model Type: Qwen2ForCausalLM
- Quantization: Dynamic Quantization
Usage
You can load this model using the Hugging Face Transformers library:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("ShubhaLabs/quantized_qwen_model")
tokenizer = AutoTokenizer.from_pretrained("ShubhaLabs/quantized_qwen_model")
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024