Downloads · 30 days
0
phi15-retail-sql-lora-jetson-v2
InfometryINC/phi15-retail-sql-lora-jetson-v2
phi15-retail-sql-lora-jetson-v2 is a text generation model from InfometryINC. Use it when you need the model to write or continue text. It is set up for transformers.
- Base model : microsoft/phi-15 - Method : QLoRA (4-bit NF4 + fp16 compute, bitsandbytes 0.48.0.dev0) - Device : NVIDIA Jetson Orin Nano 8GB / JetPack 6.2 - Samples : 1000 | Epochs: 5 | LR: 0.0002 - BLEU : 0.31% | Exa…
Access
Public
Updated Jun 15, 2026
Repo size
56.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors56.7 MB · 94%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Jun 9, 2026
- Updated
- Jun 15, 2026
- SHA
- 11b7dd07
Try a prompt
Model card
From the Hugging Face model README
Phi-1.5 TPC-DS SQL QLoRA — v2 (Jetson)
- Base model : microsoft/phi-1_5
- Method : QLoRA (4-bit NF4 + fp16 compute, bitsandbytes 0.48.0.dev0)
- Device : NVIDIA Jetson Orin Nano 8GB / JetPack 6.2
- Samples : 1000 | Epochs: 5 | LR: 0.0002
- BLEU : 0.31% | Exact Match: 0.0%
- Trained : 2026-06-09T21:06:58.536747
Load this adapter
from transformers import AutoModelForCausalLM, BitsAndBytesConfig
from peft import PeftModel
import torch
bnb = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.float16)
base = AutoModelForCausalLM.from_pretrained(
"microsoft/phi-1_5", quantization_config=bnb,
device_map={"": 0}, trust_remote_code=True)
model = PeftModel.from_pretrained(base, "InfometryINC/phi15-retail-sql-lora-jetson-v2")
- Task
- Text Generation
- Library
- transformers
- Created
- Jun 9, 2026
- Updated
- Jun 15, 2026