Downloads · 30 days
348
6% of all-time downloads
Revela-code-500M
trumancai/Revela-code-500M
Revela-code-500M is a machine learning model from trumancai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
Revela-code-500M is a self-supervised code retriever built on the 3 B-parameter Qwen2.5-0.5B backbone. It was trained on 358 K batches of code-centric text (Stack Overflow, tutorials, API docs) using the Revela next-t…
All-time downloads
5.4K
Public
Repo size
282 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors282 MB · 100%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Oct 7, 2025
- Updated
- Oct 7, 2025
- SHA
- c241f5bd
Base models
Model card
From the Hugging Face model README
Model Summary
Revela-code-500M is a self-supervised code retriever built on the 3 B-parameter Qwen2.5-0.5B backbone.
It was trained on 358 K batches of code-centric text (Stack Overflow, tutorials, API docs) using the Revela next-token-prediction + in-batch attention objective.
Use it for code-search, question-answer navigation, or hybrid doc/code retrieval.
- Repository: TRUMANCFY/Revela
- Training Dataset: trumancai/revela_code_training_corpus
Other Links
| Binary | Description |
|---|---|
| trumancai/Revela-code-3b | 3 B-parameter code-retriever. |
| trumancai/Revela-code-1b | 1 B-parameter code-retriever. |
| trumancai/Revela-code-500M | 500 M-parameter code-retriever. |
| trumancai/Revela-3b | 3 B-parameter Wikipedia retriever. |
| trumancai/Revela-1b | 1 B-parameter Wikipedia retriever. |
| trumancai/Revela-500M | 500 M-parameter Wikipedia retriever. |
| trumancai/revela_code_training_corpus | Code training corpus. |
| trumancai/revela_training_corpus | Wikipedia training corpus. |
Usage
from mteb.model_meta import ModelMeta
from mteb.models.repllama_models import RepLLaMAWrapper, _loader
import mteb, torch
revela_llama_code_3b = ModelMeta(
loader=_loader(
RepLLaMAWrapper,
base_model_name_or_path="meta-llama/Llama-3.2-3B",
peft_model_name_or_path="trumancai/Revela-code-3b",
device_map="auto",
torch_dtype=torch.bfloat16,
),
name="trumancai/Revela-code-3b",
languages=["eng_Latn"],
open_source=True,
revision="974f4d8e7ff5d5439cc1863088948249f612c284",
release_date="2025-10-07",
)
model = revela_llama_code_3b.loader()
mteb.MTEB(tasks=["AppsRetrieval"])
.run(model=model, output_folder="results/Revela-code-3b")
License
Citation
- Library
- peft
- License
- apache-2.0
- Languages
- en
- Created
- Oct 7, 2025
- Updated
- Oct 7, 2025