brahmastra-0.3-lora

BRAHMASTRA v0.3 — LoRA Adapter Only (1.1 GB)

LoRA adapter weights for Krishnapadala55/brahmastra-0.3. Apply on top of the base model unsloth/DeepSeek-R1-Distill-Qwen-32B for the same behavior as the merged model — but with a 60× smaller download.

Why download just the adapter?

• 1.1 GB vs 65 GB merged — much faster download
• Compose with other adapters (mix & match)
• Continue fine-tuning from this checkpoint
• Run on top of any quantized version of the base

Quick Start (PEFT)

import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_name = "unsloth/DeepSeek-R1-Distill-Qwen-32B"
adapter   = "Krishnapadala55/brahmastra-0.3-lora"

base = AutoModelForCausalLM.from_pretrained(base_name, torch_dtype=torch.float16, device_map="auto")
model = PeftModel.from_pretrained(base, adapter)
tokenizer = AutoTokenizer.from_pretrained(adapter)

# Optional: merge for faster inference (uses more VRAM)
model = model.merge_and_unload()

Quick Start with Unsloth (matches training recipe)

from unsloth import FastLanguageModel

model, tokenizer = FastLanguageModel.from_pretrained(
    model_name      = "Krishnapadala55/brahmastra-0.3-lora",
    max_seq_length  = 4096,
    load_in_4bit    = True,
)
FastLanguageModel.for_inference(model)

Configuration

Files

Benchmarks

See parent repo for full benchmark suite vs v0.2: Krishnapadala55/brahmastra-0.3

License

Apache 2.0 — same as base.