Skip to content

riczhou

Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm-compiled

riczhou/Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm-compiled

Llama-3-70B-Instruct-awq-int8-kv-cache-trt-llm-compiled is a machine learning model from riczhou. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

Downloads · 30 days

10

9% of all-time downloads

All-time downloads

116

Public

Repo size

39.5 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.engine39.5 GB · 100%

At a glance

Library
transformers
Access
Public
Created
May 22, 2024
Updated
May 22, 2024
SHA
f4d67d58
Library
transformers
Created
May 22, 2024
Updated
May 22, 2024