LFM2.5-2.6B-JP

LFM2.5-2.6B-JP

A Japanese fine-tuned version of LiquidAI/LFM2.5-2.6B, trained using QLoRA.

Model Details

Training Configuration

Key Settings

Chat Template

Uses LFM2.5 native ChatML-like format (not qwen3-instruct):

<|startoftext|>|user|
User message
|assistant|
Assistant response
|user|
Next user message
|assistant|
...

Special tokens:

• <|startoftext|> (BOS, id 124894)
• |user| / |assistant| — role delimiters (in tokenizer as newline + special tokens)
• <|pad|> (id 124893), <|endoftext|> (id 124895)

The training script verified the native template at runtime (preflight check) and uses train_on_responses_only with instruction_part="|user|" and response_part="|assistant|".

Dataset

Only msfm/ichikara-instruction-all (CC-BY-NC-SA-4.0).

• Format: text (instruction) + output (response) → converted to chat template.
• No data mixing; pure ichikara for license clarity (CC-BY-NC-SA-4.0).

Usage

Hugging Face Transformers (Python)

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "/path/to/LFM2.5-2.6B-JP-0811"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,  # Required for Lfm2ForCausalLM
)

messages = [
    {"role": "user", "content": "日本語で自己紹介してください。"}
]

# Apply chat template
prompt = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)

inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512, do_sample=True, temperature=0.7)
response = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
print(response)

llama.cpp (GGUF)

# Recommended: Q4_K_M (best quality/size ratio)
./llama-cli -m LFM2.5-2.6B-JP-Q4_K_M.gguf -p "<|startoftext|>|user|
日本語で自己紹介してください。
|assistant|
" -n 512 -cnv

Ollama (via Modelfile)

FROM ./LFM2.5-2.6B-JP-Q4_K_M.gguf
TEMPLATE """{{- bos_token -}}
{{- if .System }}|system|
{{ .System }}
|assistant|
{{- end }}
{{- range .Messages }}
{{- if eq .Role "user" }}|user|
{{ .Content }}
|assistant|
{{- else }}{{ .Content }}
|assistant|
{{- end }}
{{- end }}"""
PARAMETER stop "|user|"
PARAMETER stop "|assistant|"
PARAMETER stop "

"

License

This model inherits CC-BY-NC-SA-4.0 from the training dataset (msfm/ichikara-instruction-all).

• Non-commercial — Commercial use prohibited.
• ShareAlike — Derivatives must use the same license.
• Attribution — Credit the original dataset authors.

The base model (LiquidAI/LFM2.5-2.6B) has its own license; please check the model card for details.