Downloads · 30 days
10
27% of all-time downloads
multiformer-m1
FoamoftheSea/multiformer-m1
multiformer-m1 is a machine learning model from FoamoftheSea. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
37
Public
Parameters
8.2M
36.3 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors32.9 MB · 91%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- multiformer
- Access
- Public
- Created
- Dec 10, 2023
- Updated
- Dec 13, 2023
- SHA
- baa5f3fe
Model card
From the Hugging Face model README
Multiformer
Multiformer is a multi-task vision transformer architecture designed to provide strong perception capabilities with a nimble and lightweight architecture.
This model uses a custom branch of the transformers library, which can be installed easily using the instructions below.
For training and evaluation, a custom MultitaskTrainer class is used that can handle complex nested losses and successfully log them to wandb.
A training/eval and inference script are both available in the project repository.
Setup Instructions
- Open a terminal and navigate to your root folder, then run
git clone https://github.com/FoamoftheSea/shift-experiments.git
- Follow the setup instructions for your operating system found in the README
Quick Load Multiformer-M1
You should now be able to run the following code to load a Multiformer-M1 with pretrained weights:
from transformers import AutoModel
multiformer = AutoModel.from_pretrained("FoamoftheSea/multiformer-m1)
- Library
- transformers
- Type
- multiformer
- License
- apache-2.0
- Created
- Dec 10, 2023
- Updated
- Dec 13, 2023