Downloads · 30 days
13
2% of all-time downloads
malaysian-mistral-64M-MLM-512
mesolitica/malaysian-mistral-64M-MLM-512
malaysian-mistral-64M-MLM-512 is a feature extraction model from mesolitica. Use it when you need embeddings to search or compare text. It is set up for transformers.
Replicating https://github.com/McGill-NLP/llm2vec using https://huggingface.co/mesolitica/malaysian-mistral-64M-4096, done by https://github.com/aisyahrzk https://twitter.com/aisyahhhrzk
All-time downloads
573
Public
Parameters
64.2M
771 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors257 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- mistral
- Access
- Public
- Created
- Apr 17, 2024
- Updated
- Apr 20, 2024
- SHA
- e046aab2
Model card
From the Hugging Face model README
Malaysian Mistral 64M on MLM task using 512 context length
Replicating https://github.com/McGill-NLP/llm2vec using https://huggingface.co/mesolitica/malaysian-mistral-64M-4096, done by https://github.com/aisyahrzk https://twitter.com/aisyahhhrzk
Source code at https://github.com/mesolitica/malaya/tree/master/session/llm2vec
WandB, https://wandb.ai/aisyahrazak/mistral-64M-mlm?nw=nwuseraisyahrazak
- Task
- Feature Extraction
- Library
- transformers
- Type
- mistral
- Languages
- ms
- Created
- Apr 17, 2024
- Updated
- Apr 20, 2024