xformAI

opt-125m-gqa-ub-6-best-for-KV-cache

xformAI/opt-125m-gqa-ub-6-best-for-KV-cache

opt-125m-gqa-ub-6-best-for-KV-cache is a text generation model from xformAI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is a GQA version of the original model facebook/opt-125m. In this version, the original MHA architecture is preserved but instead of having a single K/V head, different K/V heads corresponding to the same group h…