Downloads · 30 days
6
3% of all-time downloads
cszhzleo/Llama-2-7b-chat-hf-nc2-bs1-token1024-neuron-218
Llama-2-7b-chat-hf-nc2-bs1-token1024-neuron-218 is a text generation model from cszhzleo. Use it when you need the model to write or continue text. It is set up for transformers.
Compiled Llama-2-7b-chat-hf using optimum-neuron
Downloads · 30 days
6
3% of all-time downloads
All-time downloads
192
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.weight13.5 GB · 99%
From the Hugging Face model README
Compiled Llama-2-7b-chat-hf using optimum-neuron
optimum-cli export neuron --model NousResearch/Llama-2-7b-chat-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/NousResearch/Llama-2-7b-chat-hf