Downloads · 30 days
11
27% of all-time downloads
d4nieldev/gemma-3-4b-it-qpl-decomposer
gemma-3-4b-it-qpl-decomposer is a machine learning model from d4nieldev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Downloads · 30 days
11
27% of all-time downloads
All-time downloads
41
Public
Repo size
427 MB
Likes
0
Public
Click a slice to open those files.
.pt239 MB · 56%
From the Hugging Face model README
To load the model and tokenizer:
from transformers import AutoTokenizer
from peft import AutoPeftModelForCausalLM
add_special_tokens = False
# Load model & tokenizer
model_path = "d4nieldev/gemma-3-4b-it-qpl-decomposer"
model = AutoPeftModelForCausalLM.from_pretrained(model_path).cuda()
model = model.eval()
tokenizer = AutoTokenizer.from_pretrained(model_path)