Downloads · 30 days
7
6% of all-time downloads
train-modle2
fokan/train-modle2
train-modle2 is a feature extraction model from fokan. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as apache-2.0.
This model was created using knowledge distillation from the following teacher model(s):
All-time downloads
126
Public
Repo size
139 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors56.7 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- apache-2.0
- Model type
- distilled_student
- Access
- Public
- Created
- Aug 26, 2025
- Updated
- Aug 26, 2025
- SHA
- a05fc308
Base models
Model card
From the Hugging Face model README
fokan/train-modle2
This model was created using knowledge distillation from the following teacher model(s):
Model Description
A distilled model created using multi-modal knowledge distillation.
Training Details
- Teacher Models:
- Distillation Strategy: weighted
- Training Steps: 5000
- Learning Rate: 0.001
Usage
from transformers import AutoModel, AutoTokenizer
model = AutoModel.from_pretrained("fokan/train-modle2")
tokenizer = AutoTokenizer.from_pretrained("bert-base-uncased")
Created with
This model was created using the Multi-Modal Knowledge Distillation platform.
- Task
- Feature Extraction
- Library
- transformers
- Type
- distilled_student
- License
- apache-2.0
- Created
- Aug 26, 2025
- Updated
- Aug 26, 2025