Downloads · 30 days
0
keonkim/coreb-task-type-router-f2llmv2-330m-c2llm-7b
coreb-task-type-router-f2llmv2-330m-c2llm-7b is a feature extraction model from keonkim. Use it when you need embeddings to search or compare text. It is set up for mteb. The card lists the license as apache-2.0.
This is a deterministic, training-free MTEB router for code retrieval:
Downloads · 30 days
0
Access
Public
Updated Jul 26, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
.md2.7 KB · 59%
From the Hugging Face model README
This is a deterministic, training-free MTEB router for code retrieval:
Retrieval tasks route to
codefuse-ai/F2LLM-v2-330M
at revision e8ef9a8eb907a9dffdd9442424a967ba73e70d31.Reranking tasks route to
codefuse-ai/C2LLM-7B
at revision c1dc16d6d64eb962c783bfb36a6d9c2f24a86dca.The router reads only the coarse public TaskMetadata.type field. It does not
inspect the benchmark name, examples, labels, or scores. Evaluation keeps only
one child model resident at a time.
The composition was selected after comparing public CoREB results and is therefore leaderboard-adapted. CoREB exposes only a test split. The submitted result should be interpreted as the performance of this transparent routing policy, not as evidence of zero-shot model selection.
The output dimension depends on the route:
| MTEB task type | Model | Dimension | Configured max tokens |
|---|---|---|---|
| Retrieval | F2LLM-v2-330M | 896 | 8,192 |
| Reranking | C2LLM-7B | 3,584 | 2,048 |
Each individual evaluation task has a fixed output dimension. Current MTEB
ModelMeta has no representation for task-dependent dimensions, so the model
implementation leaves embed_dim unset.
| Task | Main score |
|---|---|
| CorebC2CReranking | 0.42461 |
| CorebC2CRetrieval | 0.54383 |
| CorebC2TReranking | 0.95751 |
| CorebC2TRetrieval | 0.96794 |
| CorebT2CReranking | 0.28561 |
| CorebT2CRetrieval | 0.43093 |
| Macro mean | 0.6017383 |
All six results were newly evaluated through the router with MTEB 2.18.6 on an NVIDIA L4. Retrieval used bfloat16, batch size 4, and F2LLM's configured FlashAttention 2 implementation. Reranking used bfloat16, batch size 2, and C2LLM's official attention configuration.
The MTEB model implementation pins both child model revisions and delegates to each child's official MTEB loader configuration. In particular, the F2LLM Retrieval route uses its configured bfloat16/FlashAttention 2 implementation, while the C2LLM Reranking route keeps C2LLM's official adapter defaults. Evaluate all six CoREB v1 tasks with MTEB 2.18.6 and CUDA. The submission includes per-task MTEB JSON results, an environment record, and the complete run log.