boostedv1

BoostedV1

Continued LoRA training of deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B for improved reasoning and code generation. This model is the merged output of the boostedv1train pipeline: 400 MLX LoRA steps (Apple Silicon) + 550 Phase-1 continuation steps (dual RTX 3090, bf16).

Architecture

• Base: DeepSeek-R1-Distill-Qwen-1.5B (Qwen2ForCausalLM, 1.5B params)
• LoRA rank 8, alpha 160, on layers 20-27 (q/k/v/o + gate/up/down)
• Merged into a standalone model (no LoRA needed at inference)

Training

Evaluation

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained('auryn-macmillan/boostedv1') tok = AutoTokenizer.from_pretrained('auryn-macmillan/boostedv1') inputs = tok('What is 2+2?', return_tensors='pt') out = model.generate(**inputs, max_new_tokens=128) print(tok.decode(out[0]))

Notes

• Standard Qwen2 architecture, no custom code, no trust_remote_code needed.
• Trained in an isolated container; repo contains no training code or data.