Downloads · 30 days
2
1% of all-time downloads
alpindale/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft-perm
Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft-perm is a machine learning model from alpindale. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is based on https://huggingface.co/VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft, with the perms absorbed with:
Downloads · 30 days
2
1% of all-time downloads
All-time downloads
371
Public
Parameters
24B
85.7 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors85.7 GB · 100%
How the weights are stored.
I3218.8B · 78%
From the Hugging Face model README
This is based on https://huggingface.co/VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft, with the perms absorbed with:
pip install vptq && python -m vptq.tools.pre_process --input_path <original model> --output_path <new model>