Skip to content

riczhou

Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm

riczhou/Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm

Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm is a machine learning model from riczhou. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

Downloads · 30 days

11

19% of all-time downloads

All-time downloads

58

Public

Repo size

40.5 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors40.5 GB · 100%

At a glance

Library
transformers
Access
Public
Created
May 22, 2024
Updated
May 22, 2024
SHA
0fdf2459
Library
transformers
Created
May 22, 2024
Updated
May 22, 2024