Downloads · 30 days
12
2% of all-time downloads
Meta-Llama-3-8B-GGUF-Qx_0-imatrix
AriWeinstein/Meta-Llama-3-8B-GGUF-Qx_0-imatrix
Meta-Llama-3-8B-GGUF-Qx_0-imatrix is a text generation model from AriWeinstein. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
- This is GGUF quantized version of meta-llama/Meta-Llama-3-8B-Instruct created using llama.cpp.
All-time downloads
658
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 1, 2024
- Updated
- May 1, 2024
- SHA
- 6d669586
Try a prompt
Model card
From the Hugging Face model README
Meta-Llama-3-8B-Instruct-GGUF
-
This is GGUF quantized version of meta-llama/Meta-Llama-3-8B-Instruct created using llama.cpp.
-
imatrix from here.
-
Using llama.cpp revision a8f9b076316e16aadd0791015b3bfd446fe1e904, after "llama : fix BPE pre-tokenization (#6920)"
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Created
- May 1, 2024
- Updated
- May 1, 2024