Downloads · 30 days
15
13% of all-time downloads
shisa-ai/shisa-v2-llama3.1-405b-W8A8-INT8
shisa-v2-llama3.1-405b-W8A8-INT8 is a text generation model from shisa-ai. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
Quantized w/ llm-compressor using shisa-ai/shisa-v2-sharegpt as the calibration set.
Downloads · 30 days
15
13% of all-time downloads
All-time downloads
118
Public
Parameters
406B
410 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors410 GB · 100%
How the weights are stored.
I8402B · 99%
From the Hugging Face model README
Quantized w/ llm-compressor using shisa-ai/shisa-v2-sharegpt as the calibration set.
Original model: shisa-ai/shisa-v2-llama3.1-405b