Downloads · 30 days
8
4% of all-time downloads
cszhzleo/vicuna-7b-v1.5-nc2-bs1-token1024-neuron-218
vicuna-7b-v1.5-nc2-bs1-token1024-neuron-218 is a text generation model from cszhzleo. Use it when you need the model to write or continue text. It is set up for transformers.
Compiled lmsys/vicuna-7b-v1.5 using optimum-neuron (optimum-neuron==0.0.21 neuron with 2.18.2)
Downloads · 30 days
8
4% of all-time downloads
All-time downloads
190
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.weight13.5 GB · 99%
From the Hugging Face model README
Compiled lmsys/vicuna-7b-v1.5 using optimum-neuron (optimum-neuron==0.0.21 neuron with 2.18.2)
optimum-cli export neuron --model lmsys/vicuna-7b-v1.5 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/lmsys/vicuna-7b-v1.5