Downloads · 30 days
10
11% of all-time downloads
Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int8
qwen2.5-1.5b-buildeng-openvino-int8 is a text generation model from Irfanuruchi. Use it when you need the model to write or continue text. It is set up for openvino. The card lists the license as apache-2.0.
Intel optimized version of BuildEng 1.5B.
Downloads · 30 days
10
11% of all-time downloads
All-time downloads
87
Public
Repo size
1.6 GB
Likes
0
Public
Click a slice to open those files.
.bin1.6 GB · 99%
From the Hugging Face model README
Intel optimized version of BuildEng 1.5B.
This INT8 version keeps more precision than INT4 while still staying lightweight and practical for OpenVINO inference on Intel hardware.
BuildEng is an AI assistant. It should not replace professional engineering judgment, real site inspections, licensed structural assessments, or local building codes.
Use it as support, not as final authority.
pip install "optimum-intel[openvino]" openvino transformers
from optimum.intel.openvino import OVModelForCausalLM
from transformers import AutoTokenizer
model_id = "Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int8"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id, device="CPU", compile=True)
messages = [
{"role": "system", "content": "You are BuildEng. Give concise, inspection-first building engineering guidance."},
{"role": "user", "content": "A homeowner reports diagonal cracks near a window corner. What should be inspected first?"}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=160, do_sample=False)
new_tokens = output[0][inputs["input_ids"].shape[-1]:]
print(tokenizer.decode(new_tokens, skip_special_tokens=True))
| Format | Repository |
|---|---|
| Hugging Face | Irfanuruchi/qwen2.5-1.5b-buildeng |
| GGUF | Irfanuruchi/qwen2.5-1.5b-buildeng-GGUF-Q4_K_M |
| MLX 4-bit | Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-4bit |
| MLX 8-bit | Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-8bit |
| OpenVINO INT4 | Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int4 |
Built by Irfan Uruçi
Computer Engineer