Downloads · 30 days
71
26% of all-time downloads
DevQuasar/meta-llama.Meta-Llama-3-8B-Instruct-NVFP4A16
meta-llama.Meta-Llama-3-8B-Instruct-NVFP4A16 is a text generation model from DevQuasar. Use it when you need the model to write or continue text.
experimental NVFP4A16 (confirmed forking with vLLM)
Downloads · 30 days
71
26% of all-time downloads
All-time downloads
277
Public
Parameters
5B
6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6 GB · 100%
How the weights are stored.
U83.5B · 70%
From the Hugging Face model README
experimental NVFP4A16 (confirmed forking with vLLM)
Please report if you find any issue with the model.
Any feedbacks are welcome!
'Make knowledge free for everyone'
Quantized version of: meta-llama/Meta-Llama-3-8B-Instruct <a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>