Downloads · 30 days
14
22% of all-time downloads
proposer-basicfns-opt125m-sft2k
abhishekraok/proposer-basicfns-opt125m-sft2k
proposer-basicfns-opt125m-sft2k is a machine learning model from abhishekraok. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A PBE task proposer model. Model that generates a random sequence of functions that will transform given inputs to outputs. We start with the pre-trained OPT 125M model, then finetune on a random list of functions. Th…
All-time downloads
63
Public
Parameters
125M
1.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors501 MB · 99%
At a glance
- License
- apache-2.0
- Model type
- opt
- Access
- Public
- Created
- Oct 9, 2025
- Updated
- Aug 11, 2026
- SHA
- f16f85b6
Base models
Model card
From the Hugging Face model README
A PBE task proposer model. Model that generates a random sequence of functions that will transform given inputs to outputs. We start with the pre-trained OPT 125M model, then finetune on a random list of functions. This can be later be optimized using RL. The SFT training ensures that the model starts with a good baseline for future RL training. The model is trained to output a valid list of functions from the common_functions.py file.
We measure accuracy, ratio of valid tasks generated. When evaluated using this gives the result of
python wandering_light/evals/evaluate_proposer.py --model abhishekraok/proposer-basicfns-opt125m-sft2k --solver-model abhishekraok/induction-basicfns-opt125m-longsft
EvalResult(parse_rate=0.96, avg_function_count=2.02, avg_function_count_ratio=1.38, solver_success_rate=0.15, num_samples=100, frac_non_zero_std=0.31)
See the wandering-light repo for more details.
- Type
- opt
- License
- apache-2.0
- Languages
- en
- Created
- Oct 9, 2025
- Updated
- Aug 11, 2026