Downloads · 30 days
0
mohitsha/Llama-2-7b-chat-hf-AMMO-TRT
Llama-2-7b-chat-hf-AMMO-TRT is a machine learning model from mohitsha. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Generated using https://github.com/vllm-project/vllm/blob/main/examples/fp8/quantizer/quantize.py
Downloads · 30 days
0
Access
Public
Updated Jun 25, 2024
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors13.5 GB · 100%
From the Hugging Face model README
Generated using https://github.com/vllm-project/vllm/blob/main/examples/fp8/quantizer/quantize.py