Downloads · 30 days
19
1% of all-time downloads
cszhzleo/Meta-Llama-3-8B-Instruct-nc2-bs1-token1024-neuron-218
Meta-Llama-3-8B-Instruct-nc2-bs1-token1024-neuron-218 is a text generation model from cszhzleo. Use it when you need the model to write or continue text. It is set up for transformers.
Compiled Meta-Llama-3-8B-Instruct using optimum-neuron
Downloads · 30 days
19
1% of all-time downloads
All-time downloads
2.3K
Public
Repo size
32.3 GB
Likes
0
Public
Click a slice to open those files.
.weight16.1 GB · 100%
From the Hugging Face model README
Compiled Meta-Llama-3-8B-Instruct using optimum-neuron
optimum-cli export neuron --model NousResearch/Meta-Llama-3-8B-Instruct --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/NousResearch/Meta-Llama-3-8B-Instruct```