ig1

Qwen2.5-Coder-32B-Instruct-FP8-Dynamic

ig1/Qwen2.5-Coder-32B-Instruct-FP8-Dynamic

Qwen2.5-Coder-32B-Instruct-FP8-Dynamic is a text generation model from ig1. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

FP8 activation quantization performed with llm-compressor