Downloads · 30 days
0
Irfanuruchi/qwen2.5-1.5b-hvac-precheck-lora-v5
qwen2.5-1.5b-hvac-precheck-lora-v5 is a machine learning model from Irfanuruchi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Repository: Irfanuruchi/qwen2.5-1.5b-buildeng-precheck-lora-v5 Base model: Qwen2.5-1.5B-Instruct Fine-tuning method: LoRA (Unsloth)
Downloads · 30 days
0
Access
Public
Updated Mar 10, 2026
Repo size
85.3 MB
Likes
0
Public
Click a slice to open those files.
.safetensors73.9 MB · 82%
From the Hugging Face model README
Repository: Irfanuruchi/qwen2.5-1.5b-buildeng-precheck-lora-v5
Base model: Qwen2.5-1.5B-Instruct
Fine-tuning method: LoRA (Unsloth)
This repository provides a LoRA adapter for Qwen2.5-1.5B-Instruct fine-tuned for building engineering reasoning tasks.
The goal of this project is to create a lightweight domain-specific assistant capable of performing engineering pre-check calculations and sanity validation.
The model focuses on early-stage engineering estimation, supporting tasks such as:
• HVAC duct sizing
• Hydronic pipe sizing
• Fan and pump power estimation
• Heat transfer calculations
• Structural pre-check calculations
• Engineering unit sanity checks
• Detection of missing or unrealistic design inputs
This model acts as an engineering assistant for early concept validation, not as a replacement for professional engineering verification.
Base Model: Qwen2.5-1.5B-Instruct
Framework: Unsloth
Fine-tuning Method: LoRA
| Parameter | Value |
|---|---|
| LoRA rank | 32 |
| LoRA alpha | 32 |
| Quantization | 4-bit |
| Sequence length | 1536 |
| Optimizer | AdamW 8-bit |
| Learning rate | 1.5e-4 |
| Scheduler | Cosine |
| Training steps | 3000 |
| Train dataset | ~57k samples |
| Validation dataset | ~3k samples |
The dataset consists of synthetic engineering problems generated using physics-based equations covering HVAC, hydronics, heat transfer, and structural estimation.
Input
Airflow = 3500 m³/h
Velocity = 6 m/s
Output
Select round duct ≈ Ø480 mm
Steps
Q = 0.972 m³/s
A = 0.162 m²
d ≈ 480 mm
Input
Flow = 4 m³/h
Head = 20 m
Efficiency = 0.7
Output
Pump power ≈ 0.31 kW
Steps
P = ρ g Q H / η
Input
Moment = 20 kNm
Section modulus = 250 cm³
Output
Bending stress ≈ 80 MPa
Input
Size round duct
Airflow = 0.3 m³/h
Velocity = 5 m/s
Output
Airflow extremely small for HVAC systems.
Likely unit mismatch — confirm m³/h vs m³/s.
• duct sizing
• fan power estimation
• cooling coil loads
• pipe velocity sizing
• pump power estimation
• water flow calculations
• wall heat loss estimation
• beam bending stress
• beam deflection estimation
• tributary load calculation
• slab load estimation
• unrealistic velocities
• unrealistic ΔT values
• unit mismatches
• missing critical inputs
This model is experimental and intended for educational or exploratory use.
Known limitations include:
• calculations may require verification
• reasoning depth is limited by model size
• structural calculations are simplified
• model should not be used for final engineering design
All results must be validated using professional engineering standards (ASHRAE, Eurocode, etc.).
Load the base model and apply the LoRA adapter.
Example using Unsloth:
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="Qwen/Qwen2.5-1.5B-Instruct",
load_in_4bit=True
)
model.load_adapter("path_to_adapter")
FastLanguageModel.for_inference(model)
The model was trained on the following dataset:
https://huggingface.co/datasets/Irfanuruchi/building-engineering-synthetic-dataset-v5
This model is designed for:
• educational engineering demonstrations
• quick engineering pre-check calculations
• concept-stage HVAC sizing
• structural estimation checks
It should never be used for safety-critical engineering decisions without verification.
Planned improvements include:
• expanding dataset beyond 100k engineering problems
• deeper structural engineering reasoning
• multi-step engineering calculation chains
• integration of engineering standards (ASHRAE, Eurocode)
• improved unit consistency detection
V1 – Initial experiments
V2 – Dataset structure improvements
V3 – HVAC reasoning tasks
V4 – Engineering pre-check assistant (~5k dataset)
V5 – Expanded dataset (~60k), HVAC + structural reasoning + engineering sanity checks
Irfan Uruchi
This project explores lightweight domain-specialized LLMs for engineering reasoning and pre-design validation (also used as testing for my 32B parameter LLM launching by June).