cd3arg-Qwen2.5-1.5B-Instruct-STaR-SFT

SkillFactory/cd3arg-Qwen2.5-1.5B-Instruct-STaR-SFT

cd3arg-Qwen2.5-1.5B-Instruct-STaR-SFT is a machine learning model from SkillFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This model was created as part of the RC-absftboncorrsamples experiment using the SkillFactory experiment management system.

Downloads · 30 days

33% of all-time downloads

All-time downloads

Public

Parameters

1.5B

3.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors3.1 GB · 99%

At a glance

Model type: qwen2
Access: Public
Created: Dec 4, 2025
Updated: Dec 4, 2025
SHA: b319f3cc

Model card

From the Hugging Face model README

M-RC-ab_sft_bon_corr_samples-sft

This model was created as part of the RC-ab_sft_bon_corr_samples experiment using the SkillFactory experiment management system.

Model Details

Training Method: LLaMAFactory SFT (Supervised Fine-Tuning)
Stage Name: sft
Experiment: RC-ab_sft_bon_corr_samples

Training Configuration

{"model_name_or_path": "Qwen/Qwen2.5-1.5B-Instruct", "trust_remote_code": true, "stage": "sft", "do_train": true, "finetuning_type": "full", "deepspeed": "/scratch/10416/zaynesprague/skill_factory_dir/skill-factory/thirdparty/LLaMA-Factory/examples/deepspeed/ds_z2_config.json", "dataset": "TAUR_dev__D_SFT_C_RC_ab_sft_bon_corr_samples_sft_data__sft_train", "template": "qwen", "cutoff_len": 16384, "max_samples": 1000000, "overwrite_cache": true, "preprocessing_num_workers": 1, "dataloader_num_workers": 0, "disable_tqdm": false, "output_dir": "/scratch/10416/zaynesprague/skill_inject_outputs/sf_experiments/RC_ab_sft_bon_corr_samples/llamafactory/checkpoints", "logging_steps": 10, "save_steps": 100000, "plot_loss": true, "overwrite_output_dir": true, "per_device_train_batch_size": 1, "gradient_accumulation_steps": 1, "learning_rate": 1e-06, "num_train_epochs": 1, "lr_scheduler_type": "cosine", "warmup_ratio": 0.05, "weight_decay": 0.0001, "adam_beta1": 0.9, "adam_beta2": 0.95, "bf16": true, "ddp_timeout": 180000000, "gradient_checkpointing": true, "save_only_model": true, "enable_masked_ranges": false, "save_strategy": "steps", "save_total_limit": 5, "sf_tracker_dataset_id": "TAUR-dev/D-ExpTracker__RC-ab_sft_bon_corr_samples__v1", "sf_eval_before_training": false, "sf_wandb_project": "RC-ab_sft_bon_corr_samples_sft", "sf_eval_steps": null, "run_name": "RC-ab_sft_bon_corr_samples_sft"}

Experiment Tracking

🔗 View complete experiment details: Experiment Tracker Dataset

Usage

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("TAUR-dev/M-RC-ab_sft_bon_corr_samples-sft")
model = AutoModelForCausalLM.from_pretrained("TAUR-dev/M-RC-ab_sft_bon_corr_samples-sft")

Type: qwen2
Created: Dec 4, 2025
Updated: Dec 4, 2025