Skip to content

saarvajanik

facebook-opt-6.7b-qcqa-ub-16-best-for-KV-cache

saarvajanik/facebook-opt-6.7b-qcqa-ub-16-best-for-KV-cache

facebook-opt-6.7b-qcqa-ub-16-best-for-KV-cache is a text generation model from saarvajanik. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is a GQA version of the original model facebook/opt-125m. In this version, the original MHA architecture is preserved but instead of having a single K/V head, different K/V heads corresponding to the same group h…

Downloads · 30 days

71

0% of all-time downloads

All-time downloads

15.7K

Public

Repo size

54.9 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin27.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
mit
Model type
opt
Access
Public
Created
Jan 28, 2024
Updated
Jan 28, 2024
SHA
42a63c80

Try a prompt

Task
Text Generation
Library
transformers
Type
opt
License
mit
Languages
en
Created
Jan 28, 2024
Updated
Jan 28, 2024