Skip to content

jmvcoelho

Qwen2.5-0.5B-bidirectional-attn-mntp

jmvcoelho/Qwen2.5-0.5B-bidirectional-attn-mntp

Qwen2.5-0.5B-bidirectional-attn-mntp is a machine learning model from jmvcoelho. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Qwen2.5-0.5 with bidirectional attention continually pre-trained on MS-MARCO documents for masked next token prediction, as per LLM2VEC.

Downloads · 30 days

7

12% of all-time downloads

All-time downloads

57

Public

Parameters

494M

988 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors988 MB · 99%

At a glance

Model type
qwen2ba
Access
Public
Created
May 22, 2025
Updated
May 22, 2025
SHA
221f4b06
Type
qwen2ba
Created
May 22, 2025
Updated
May 22, 2025