Downloads · 30 days
0
justinchuby/onnx-genai-example-qwen2-5-1-5b-lora-selection
onnx-genai-example-qwen2-5-1-5b-lora-selection is a machine learning model from justinchuby. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
Public real-weight ONNX package from Qwen/Qwen2.5-1.5B-Instruct at 989aa7980e4cf806f80c7fef2b1adb7bc71aa306, with matching PEFT adapter bharati2324/Qwen2.5-1.5B-Instruct-Code-LoRA-r16 at 57a4a23b934ea6c3f25615e13a6979…
Downloads · 30 days
0
Access
Public
Updated Aug 26, 2026
Repo size
3.6 GB
Likes
0
Public
Click a slice to open those files.
.data3.1 GB · 85%
From the Hugging Face model README
Public real-weight ONNX package from Qwen/Qwen2.5-1.5B-Instruct at 989aa7980e4cf806f80c7fef2b1adb7bc71aa306, with matching PEFT adapter bharati2324/Qwen2.5-1.5B-Instruct-Code-LoRA-r16 at 57a4a23b934ea6c3f25615e13a6979d55c48fd68. Both sources are Apache-2.0.
Includes actual fp16 decoder and adapter weights, canonical metadata, tokenizer, policies, source provenance, request/output, graph report, and H200 CUDA timings. The real probe used logical rows at scales 0, 0.5, and 1.0; adapter rows changed final logits by 25.72–25.79 and generated different output from the base row. Installed ORT exposes whole-run adapter activation, so heterogeneous logical rows were executed independently and this limitation is explicit in output.json.
hf download justinchuby/onnx-genai-example-qwen2-5-1-5b-lora-selection --repo-type model --local-dir ./qwen2.5-1.5b-lora-selection
cd qwen2.5-1.5b-lora-selection
python3 evidence/probe_lora_onnx.py
cat evidence/lora_runtime_probe.json
Requires CUDA-capable onnxruntime-gpu, onnx-ir, transformers, safetensors, torch, and numpy; exact successful versions are in output.json.
Review inference_metadata.annotated.yaml for inline explanations of this package's workflow, tensor/state/cache contracts, and fail-closed omissions. inference_metadata.yaml remains the canonical machine-authored contract; automated validation confirms both files parse to the same metadata object.