Downloads · 30 days
18
2% of all-time downloads
winglian/Meta-Llama-3-8B-1M
Meta-Llama-3-8B-1M is a text generation model from winglian. Use it when you need the model to write or continue text. It is set up for transformers.
This is the merged Llama 3 8B 1M base model obtained from merging the Llama 3 8B model with the LoRA extracted from Gradient AI's 1M context length Instruct model https://huggingface.co/gradientai/Llama-3-8B-Instruct-…
Downloads · 30 days
18
2% of all-time downloads
All-time downloads
843
Public
Parameters
8B
31 GB on disk
Likes
6
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This is the merged Llama 3 8B 1M base model obtained from merging the Llama 3 8B model with the LoRA extracted from Gradient AI's 1M context length Instruct model https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-1048k
The LoRA adapter is available @ https://huggingface.co/winglian/llama-3-1m-context-gradient-lora