Downloads · 30 days
281
3% of all-time downloads
Meta-Llama-3.1-8B-Instruct-GGUF
aniljava/Meta-Llama-3.1-8B-Instruct-GGUF
Meta-Llama-3.1-8B-Instruct-GGUF is a text generation model from aniljava. Use it when you need the model to write or continue text. The card lists the license as other.
- 3.1 rope scaling factors (8676) - llama-bpe as tokenizer Proper Llama 3.1 Support in llama.cpp (8650) - <|pythontag| works for tool calls.
All-time downloads
9.4K
Public
Repo size
71.1 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.gguf35.5 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Jul 23, 2024
- Updated
- Jul 25, 2024
- SHA
- 0f5849ec
Try a prompt
Model card
From the Hugging Face model README
With fixes applied for:
- 3.1 rope scaling factors (#8676)
llama-bpeas tokenizer Proper Llama 3.1 Support in llama.cpp (#8650)<|python_tag|>works for tool calls.
Following files are fixed and others are being replaced.
- Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf
- Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf
REF
https://github.com/ggerganov/llama.cpp/issues/8650 https://github.com/ggerganov/llama.cpp/pull/8676
- Task
- Text Generation
- License
- other
- Languages
- en
- Created
- Jul 23, 2024
- Updated
- Jul 25, 2024