Downloads · 30 days
19
19% of all-time downloads
Airin-chan/LatenConnectionTransformers
LatenConnectionTransformers is a machine learning model from Airin-chan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for keras. The card lists the license as cc-by-4.0.
LCT (Laten Connection Model) ------------------------------- LCT is Transformers variant model that replaced Feed forward network with LCM , how its work ? LCM looking attention as upgraded signal by step1 step2 for l…
Downloads · 30 days
19
19% of all-time downloads
All-time downloads
99
Public
Repo size
5.8 MB
Likes
0
Public
Click a slice to open those files.
.keras5.7 MB · 98%
From the Hugging Face model README
LCT is Transformers variant model that replaced Feed forward network with LCM , how its work ? LCM looking attention as upgraded signal by step1 step2 for looking attention. and then, LCM will do residural connection (attention (input), laten (output)) for making reached attention signal.
LCT look processing following:
embedding => LCT Block (Attention + LCM ) xN sub model => FFN as decoder => Linear

bash
import LCT_architecture
model = keras.models.load(LCt-Tiny-version.keras)
support LCT: https://ko-fi.com/alpin92578
Candra Alpin gunawan
this model trained by 3K Conversations Dataset for ChatBot from kaggle user Kreesh Rajani datasets link: https://www.kaggle.com/datasets/kreeshrajani/3k-conversations-dataset-for-chatbot