Downloads · 30 days
9
3% of all-time downloads
Dlip-RWKV
StarRing2022/Dlip-RWKV
Dlip-RWKV is a machine learning model from StarRing2022. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as lgpl-3.0.
一种基于Clip改进的，通用HF格式的冻结LLM语言模型进行图文对齐训练的方案，以RWKV-4-World-0.4B为例，Cifar10为数据集
All-time downloads
310
Public
Repo size
4.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth2.9 GB · 76%
At a glance
- Library
- transformers
- License
- lgpl-3.0
- Model type
- rwkv
- Access
- Public
- Created
- Jul 17, 2023
- Updated
- Jul 17, 2023
- SHA
- 2ab190d2
Model card
From the Hugging Face model README
一种基于Clip改进的，通用HF格式的冻结LLM语言模型进行图文对齐训练的方案，以RWKV-4-World-0.4B为例，Cifar10为数据集
共创合作：受到visualrwkv冻结LLM模型启发（https://github.com/howard-hou/VisualRWKV）
RWKV-4-World-0.4B模型及训练30个epoch后的checkpoint文件： GIT开源地址：https://github.com/StarRing2022/Dlip-RWKV/
- Library
- transformers
- Type
- rwkv
- License
- lgpl-3.0
- Created
- Jul 17, 2023
- Updated
- Jul 17, 2023