Skip to content

horheynm

Phi-3-mini-4k-instruct-FP8-KV-QuantizedCache

horheynm/Phi-3-mini-4k-instruct-FP8-KV-QuantizedCache

Phi-3-mini-4k-instruct-FP8-KV-QuantizedCache is a machine learning model from horheynm. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

5

14% of all-time downloads

All-time downloads

35

Public

Parameters

3.8B

4 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors4 GB · 100%

Parameter types

How the weights are stored.

F8_E4M33.6B · 95%

Type
phi3
Created
Sep 13, 2024
Updated
Sep 13, 2024