Downloads · 30 days
107
5% of all-time downloads
olafgeibig/Llama-3-8B-16K-GGUF
Llama-3-8B-16K-GGUF is a text generation model from olafgeibig. Use it when you need the model to write or continue text. The card lists the license as other.
GGUF conversion and quantization of https://huggingface.co/mattshumer/Llama-3-8B-16K
Downloads · 30 days
107
5% of all-time downloads
All-time downloads
2.3K
Public
Repo size
30.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf30.4 GB · 100%
From the Hugging Face model README
GGUF conversion and quantization of https://huggingface.co/mattshumer/Llama-3-8B-16K
Done with Maxime Labonne's AutoGGUF
This is an extended (16K) context version of LLaMA 3 8B (base, not instruct). Trained for five hours on 8x A6000 GPUs, using the Yukang/LongAlpaca-16k-length dataset.
rope_theta was set to 1000000.0. Trained with Axolotl.