Downloads · 30 days
0
jclinton1/Meta-Llama-3.1-70B-Instruct-Q3_K_L
Meta-Llama-3.1-70B-Instruct-Q3_K_L is a machine learning model from jclinton1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
Just the Q3KL quantisation from bullerwins' quantisation For use in VLLM
Downloads · 30 days
0
Access
Public
Updated Sep 29, 2024
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 90%
From the Hugging Face model README
Just the Q3_K_L quantisation from bullerwins' quantisation For use in VLLM