winglian

llama-3-1m-context-gradient-lora

winglian/llama-3-1m-context-gradient-lora

llama-3-1m-context-gradient-lora is a machine learning model from winglian. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

LoRA extraction from Gradient AI's https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-1048k model. LoRA extraction only targeted from the selfattn modules. Rank: 1024