Downloads · 30 days
317
4% of all-time downloads
Llama-3-8B-16K-GGUF
QuantFactory/Llama-3-8B-16K-GGUF
Llama-3-8B-16K-GGUF is a text generation model from QuantFactory. Use it when you need the model to write or continue text. It is set up for transformers.
- This is quantized version of mattshumer/Llama-3-8B-16K created using llama.cpp
All-time downloads
8.6K
Public
Repo size
72.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf72.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Apr 24, 2024
- Updated
- Apr 24, 2024
- SHA
- 5abc4bef
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Llama-3-8B-16K-GGUF
- This is quantized version of mattshumer/Llama-3-8B-16K created using llama.cpp
Model Description
This is an extended (16K) context version of LLaMA 3 8B (base, not instruct). Trained for five hours on 8x A6000 GPUs, using the Yukang/LongAlpaca-16k-length dataset.
rope_theta was set to 1000000.0. Trained with Axolotl.
- Task
- Text Generation
- Library
- transformers
- Created
- Apr 24, 2024
- Updated
- Apr 24, 2024