Vezora

Qwen2-7B-Instruct-128k-GGUF

Vezora/Qwen2-7B-Instruct-128k-GGUF

Qwen2-7B-Instruct-128k-GGUF is a machine learning model from Vezora. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

The Qwen authors highlight in their blogpost that qwen 2 7b can handle sequences up to 128k, but the GGUF meta-data is set to 32k. This is a version with 131k max context length, Using the llama.cpp script, also avail…