gemma4_merged_tts_ms_v23

Gemma 4 TTS-Companion v23 — MERGED (CPT + SFT baked in)

Standalone merged model: google/gemma-4-E4B-it + CPT LoRA (khursanirevo/gemma4_cpt_ms)

• SFT LoRA (khursanirevo/gemma4_sft_tts_ms_v23) — all weights baked into a single 8B bf16 model. No adapter stacking needed at inference.

Use this when you want to skip peft and the CPT+SFT LoRA stacking ceremony. Just from_pretrained() and go.

Quick start

import torch
from transformers import AutoTokenizer, Gemma4ForConditionalGeneration
from pathlib import Path

MODEL = "khursanirevo/gemma4_merged_tts_ms_v23"
PERSONA = Path("persona_prompt.txt").read_text(encoding="utf-8")  # downloaded from this repo

model = Gemma4ForConditionalGeneration.from_pretrained(
    MODEL, torch_dtype=torch.bfloat16, device_map="cuda", attn_implementation="eager",
)
tok = AutoTokenizer.from_pretrained(MODEL)

messages = [
    {"role": "system", "content": PERSONA},
    {"role": "user", "content": "Jom la kita keluar makan"},
]
inputs = tok.apply_chat_template(messages, tokenize=True, return_tensors="pt", return_dict=True, add_generation_prompt=True).to("cuda")
with torch.no_grad():
    out = model.generate(**inputs, max_new_tokens=120, do_sample=False, repetition_penalty=1.15, pad_token_id=tok.pad_token_id)
print(tok.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
# "Alamak mana boleh pergi jauh-jauh. Kat sini je lah borak."

What's baked in

Merged via two passes of PeftModel.merge_and_unload() on CPU at bf16. No quantization, no pruning — exact arithmetric equivalent to running all three stacked at inference.

Persona prompt is required

Even with CPT + SFT baked in, the persona system prompt (persona_prompt.txt, bundled in this repo) must be sent as the system role message. The base model's RLHF prior on "I am AI / text-only / no voice" is too strong for LoRA alone to override — the prompt supplies the anonymous-friend framing at inference. See khursanirevo/gemma4_sft_tts_ms_v23 model card for the full architecture rationale.

Verified probe behaviors

All 6 adversarial probes pass with the persona prompt:

Limitations

• CPT shift may slightly regress v23 SFT behaviors. The v23 SFT adapter was originally trained against the base Gemma 4 (not CPT-merged). Stacking CPT underneath shifts the residual stream distribution. If probes regress, fall back to running SFT adapter alone on the base model.
• Single epoch partial SFT. The v23 SFT saw only 56% of one epoch before NaN at step 135 forced early checkpoint promotion. See SFT model card for full NaN root-cause analysis.
• No tool use / function calling. Pure conversational.

License

Gemma License (inherited from google/gemma-4-E4B-it). Merged weights retain the same license. Persona prompt (persona_prompt.txt) is CC-BY-4.0.

Citation

@misc{gemma4_merged_tts_ms_v23,
  title={Gemma 4 TTS-Companion v23 MERGED: CPT + SFT LoRA baked into base},
  author={Sani (khursanirevo)},
  year={2026},
  url={https://huggingface.co/khursanirevo/gemma4_merged_tts_ms_v23}
}