Downloads · 30 days
8
11% of all-time downloads
Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int4
qwen2.5-1.5b-buildeng-openvino-int4 is a text generation model from Irfanuruchi. Use it when you need the model to write or continue text. It is set up for openvino. The card lists the license as apache-2.0.
Intel optimized version of BuildEng 1.5B.
Downloads · 30 days
8
11% of all-time downloads
All-time downloads
75
Public
Repo size
934 MB
Likes
0
Public
Click a slice to open those files.
.bin923 MB · 98%
From the Hugging Face model README
Intel optimized version of BuildEng 1.5B.
BuildEng is a domain-specialized language model focused on building and structural engineering. This INT4 OpenVINO version is made for low memory usage and efficient inference on Intel hardware.
BuildEng is an AI assistant. It should not replace professional engineering judgment, real site inspections, licensed structural assessments, or local building codes.
Use it as support, not as final authority.
pip install "optimum-intel[openvino]" openvino transformers
from optimum.intel.openvino import OVModelForCausalLM
from transformers import AutoTokenizer
model_id = "Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int4"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id, device="CPU", compile=True)
messages = [
{"role": "system", "content": "You are BuildEng. Give concise, inspection-first building engineering guidance."},
{"role": "user", "content": "A homeowner reports diagonal cracks near a window corner. What should be inspected first?"}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=160, do_sample=False)
new_tokens = output[0][inputs["input_ids"].shape[-1]:]
print(tokenizer.decode(new_tokens, skip_special_tokens=True))
| Format | Repository |
|---|---|
| Hugging Face | Irfanuruchi/qwen2.5-1.5b-buildeng |
| GGUF | Irfanuruchi/qwen2.5-1.5b-buildeng-GGUF-Q4_K_M |
| MLX 4-bit | Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-4bit |
| MLX 8-bit | Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-8bit |
| OpenVINO INT8 | Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int8 |
Built by Irfan Uruçi
Computer Engineer