Downloads · 30 days
86
6% of all-time downloads
DevQuasar/meta-llama.Llama-3.1-8B-Instruct-NVFP4A16
meta-llama.Llama-3.1-8B-Instruct-NVFP4A16 is a text generation model from DevQuasar. Use it when you need the model to write or continue text.
<img src="https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dqlogoblack-transparent.png" width="200"/
Downloads · 30 days
86
6% of all-time downloads
All-time downloads
1.4K
Public
Parameters
5B
6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6 GB · 100%
How the weights are stored.
U83.5B · 70%
From the Hugging Face model README
'Make knowledge free for everyone'
Made with llmcompressor
Quantized version of: meta-llama/Llama-3.1-8B-Instruct <a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>