Downloads · 30 days
3
6% of all-time downloads
siddadatrao/fragrance-cpt-qwen3-32b-v2
fragrance-cpt-qwen3-32b-v2 is a text generation model from siddadatrao. Use it when you need the model to write or continue text. It is set up for peft.
Fragrance V2 is a continued-pretraining PEFT adapter for unsloth/qwen3-32b-bnb-4bit. It continues the V1 adapter siddadatrao/fragrance-cpt-qwen3-32b for an additional 500 optimizer steps on a packed corpus of fragranc…
Downloads · 30 days
3
6% of all-time downloads
All-time downloads
47
Public
Repo size
5.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors5.3 GB · 100%
From the Hugging Face model README
Fragrance V2 is a continued-pretraining PEFT adapter for
unsloth/qwen3-32b-bnb-4bit. It continues the V1 adapter
siddadatrao/fragrance-cpt-qwen3-32b for an additional 500 optimizer steps on
a packed corpus of fragrance discussions.
This model is intended for experimentation with fragrance-domain language and consumer discourse. It is not a calibrated survey simulator: probabilities or repeated samples from the model must not be interpreted as population survey percentages without separate distribution-alignment training and held-out validation.
The source corpus contains 5,926,634 fragrance-discussion rows. These were packed into 170,242 sequences with a target length of 2,048 tokens. The packing manifest estimates 325,320,274 source tokens in total.
The corpus is drawn from online fragrance discussion and is expected to overrepresent enthusiasts and active online participants. It should not be treated as a representative sample of fragrance buyers.
siddadatrao/fragrance-cpt-qwen3-32bunsloth/qwen3-32b-bnb-4bit1e-51e-60.030.0004 (69 packed sequences)4407q_proj, k_proj, v_proj, o_proj, gate_proj,
up_proj, down_proj, embed_tokens, and lm_headimport torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
adapter_id = "siddadatrao/fragrance-cpt-qwen3-32b-v2"
base_id = "unsloth/qwen3-32b-bnb-4bit"
tokenizer = AutoTokenizer.from_pretrained(adapter_id)
base = AutoModelForCausalLM.from_pretrained(
base_id,
device_map="auto",
dtype=torch.bfloat16,
)
model = PeftModel.from_pretrained(base, adapter_id)
model.eval()
The adapter is approximately 5 GB because the checkpoint includes trained embedding weights in addition to the rank-64 LoRA tensors.