Skip to content

saarvajanik

facebook-opt-6.7b-gqa-ub-16-best-for-KV-cache

saarvajanik/facebook-opt-6.7b-gqa-ub-16-best-for-KV-cache

facebook-opt-6.7b-gqa-ub-16-best-for-KV-cache is a text generation model from saarvajanik. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is a QCQA version of the original model facebook/opt-125m. In this version, the original MHA architecture is preserved but instead of having a single K/V head, different K/V heads corresponding to the same group…

Downloads · 30 days

236

1% of all-time downloads

All-time downloads

15.9K

Public

Repo size

82.4 GB

Likes

15

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin27.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
mit
Model type
opt
Access
Public
Created
Jan 28, 2024
Updated
Jan 28, 2024
SHA
4b01e3b6

Try a prompt

Task
Text Generation
Library
transformers
Type
opt
License
mit
Languages
en
Created
Jan 28, 2024
Updated
Jan 28, 2024