ramendik

Vistral-24B-Instruct-FP8

ramendik/Vistral-24B-Instruct-FP8

Vistral-24B-Instruct-FP8 is a machine learning model from ramendik. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Straightforward dynamic FP8 quant using llmcompressor. Nice for performance on Hopper and Blackwell GPUs.