Skip to content

saarvajanik

facebook-opt-6.7b-qcqa-ub-16-best-for-q-loss

saarvajanik/facebook-opt-6.7b-qcqa-ub-16-best-for-q-loss

facebook-opt-6.7b-qcqa-ub-16-best-for-q-loss is a text generation model from saarvajanik. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is a QCQA version of the original model facebook/opt-125m. In this version, the original MHA architecture is preserved but instead of having a single K/V head, different K/V heads corresponding to the same group…

Downloads · 30 days

59

0% of all-time downloads

All-time downloads

15.8K

Public

Repo size

54.9 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin27.5 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
mit
Model type
opt
Access
Public
Created
Jan 28, 2024
Updated
Jan 28, 2024
SHA
2e3897dc

Try a prompt

Task
Text Generation
Library
transformers
Type
opt
License
mit
Languages
en
Created
Jan 28, 2024
Updated
Jan 28, 2024