Downloads · 30 days
12
12% of all-time downloads
badaoui/Qwen-Qwen2.5-1.5B-Instruct-neuron
Qwen-Qwen2.5-1.5B-Instruct-neuron is a text generation model from badaoui. Use it when you need the model to write or continue text.
This repository contains AWS Neuron-optimized files for Qwen/Qwen2.5-1.5B-Instruct.
Downloads · 30 days
12
12% of all-time downloads
All-time downloads
102
Public
Repo size
5.8 MB
Likes
0
Public
Click a slice to open those files.
.pt5.8 MB · 100%
From the Hugging Face model README
This repository contains AWS Neuron-optimized files for Qwen/Qwen2.5-1.5B-Instruct.
This model has been optimized for AWS Neuron devices (Inferentia/Trainium). To use it:
from optimum.neuron import NeuronModelForCausalLM
model = NeuronModelForCausalLM.from_pretrained("badaoui/Qwen-Qwen2.5-1.5B-Instruct-neuron")
These files are pre-compiled for AWS Neuron devices and should provide improved inference performance compared to the original model when deployed on Inferentia or Trainium instances.
For the original model, training details, and more information, please visit: Qwen/Qwen2.5-1.5B-Instruct