Downloads · 30 days
0
Meta-Llama-3.1-405B-Instruct-GGUF-FIXED
RESMPDEV/Meta-Llama-3.1-405B-Instruct-GGUF-FIXED
Meta-Llama-3.1-405B-Instruct-GGUF-FIXED is a machine learning model from RESMPDEV. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
More updates. Going to be attempting a imatrix quant at Q3 so hopefully if that goes well and runs right on latest master will upload asap!
Access
Public
Updated Jul 31, 2024
Repo size
246 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.part_aa45 GB · 18%
At a glance
- License
- llama3.1
- Access
- Public
- Created
- Jul 24, 2024
- Updated
- Jul 31, 2024
- SHA
- ada1037d
Model card
From the Hugging Face model README
More updates. Going to be attempting a imatrix quant at Q3 so hopefully if that goes well and runs right on latest master will upload asap!
Not uploading Q6. This Quant may not work with your current llama.cpp build as there were breaking changes in the latest master.
Q4_K_M IS UP!
For those of you who do not know how to reassamble the parts cat Meta-Llama-3.1-405B-Instruct-Q4_K_M.gguf.part_* > Meta-Llama-3.1-405B-Instruct-Q4_K_M.gguf
Am amusing generation to kill the time. Is the instruct tuned to think it can ONLY be run on the cloud?
Why download these GGUF's? I made some modifications to the llama.cpp quantification process to for SURE use the right tokenizer vs the Smaug BPE GGUF's that are out now.
- License
- llama3.1
- Created
- Jul 24, 2024
- Updated
- Jul 31, 2024