Downloads · 30 days
3
3% of all-time downloads
neutrino12/tensorstax-sft-unsloth-32b-lora256-3020
tensorstax-sft-unsloth-32b-lora256-3020 is a text generation model from neutrino12. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a merged model created from Qwen/Qwen2.5-Coder-32B-Instruct fine-tuned with LoRA for DBT (Data Build Tool) code generation tasks.
Downloads · 30 days
3
3% of all-time downloads
All-time downloads
87
Public
Parameters
32.8B
65.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors65.5 GB · 100%
From the Hugging Face model README
This is a merged model created from Qwen/Qwen2.5-Coder-32B-Instruct fine-tuned with LoRA for DBT (Data Build Tool) code generation tasks.
python -m vllm.entrypoints.openai.api_server \
--model neutrino12/tensorstax-sft-unsloth-32b-lora256-3020 \
--host 0.0.0.0 \
--port 8000 \
--max-model-len 32768 \
--trust-remote-code
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"neutrino12/tensorstax-sft-unsloth-32b-lora256-3020",
torch_dtype="auto",
device_map="auto",
trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained(
"neutrino12/tensorstax-sft-unsloth-32b-lora256-3020",
trust_remote_code=True
)
# Generate text
inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=512)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
This model was fine-tuned using LoRA with the following configuration:
The LoRA adapter was then merged back into the full model weights for easier deployment.