Downloads · 30 days
4
7% of all-time downloads
cszhzleo/Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218
Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218 is a text generation model from cszhzleo. Use it when you need the model to write or continue text. It is set up for transformers.
Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron
Downloads · 30 days
4
7% of all-time downloads
All-time downloads
59
Public
Repo size
14.5 GB
Likes
0
Public
Click a slice to open those files.
.weight14.5 GB · 100%
From the Hugging Face model README
Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron
optimum-cli export neuron --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/mistralai/Mistral-7B-Instruct-v0.2