Downloads · 30 days
9
6% of all-time downloads
Cosine_Attention_GPT_1.2B
gmongaras/Cosine_Attention_GPT_1.2B
Cosine_Attention_GPT_1.2B is a feature extraction model from gmongaras. Use it when you need embeddings to search or compare text. The card lists the license as mit.
This repository contains the GPT-Cos-1.2b model described in Cottention: Linear Transformers With Cosine Attention.
All-time downloads
160
Public
Repo size
9.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin4.9 GB · 100%
At a glance
- Task
- Feature Extraction
- License
- mit
- Model type
- gptj
- Access
- Public
- Created
- Oct 7, 2024
- Updated
- Oct 7, 2024
- SHA
- fcfd1d7e
Model card
From the Hugging Face model README
This repository contains the GPT-Cos-1.2b model described in Cottention: Linear Transformers With Cosine Attention.
- Task
- Feature Extraction
- Type
- gptj
- License
- mit
- Created
- Oct 7, 2024
- Updated
- Oct 7, 2024