Downloads · 30 days
7
2% of all-time downloads
malaysian-mistral-474M-MLM-512
mesolitica/malaysian-mistral-474M-MLM-512
malaysian-mistral-474M-MLM-512 is a feature extraction model from mesolitica. Use it when you need embeddings to search or compare text. It is set up for transformers.
Replicating https://github.com/McGill-NLP/llm2vec using https://huggingface.co/mesolitica/malaysian-mistral-474M-4096, done by https://github.com/aisyahrzk https://twitter.com/aisyahhhrzk
All-time downloads
326
Public
Parameters
475M
7.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.9 GB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Apr 23, 2024
- Updated
- Apr 23, 2024
- SHA
- a1cc5bb6
Model card
From the Hugging Face model README
Malaysian Mistral 474M on MLM task using 512 context length
Replicating https://github.com/McGill-NLP/llm2vec using https://huggingface.co/mesolitica/malaysian-mistral-474M-4096, done by https://github.com/aisyahrzk https://twitter.com/aisyahhhrzk
Source code at https://github.com/mesolitica/malaya/tree/master/session/llm2vec
WandB, https://wandb.ai/aisyahrazak/mistral-474M-mlm?nw=nwuseraisyahrazak
- Task
- Feature Extraction
- Library
- transformers
- Type
- mistral
- Languages
- ms
- Created
- Apr 23, 2024
- Updated
- Apr 23, 2024