Code-X-SFT-27B

Code-X-SFT-27B

Code-X-SFT-27B is a research, non-commercial supervised fine-tune of Qwen/Qwen3.6-27B for coding-agent workflows. This repository contains the consolidated full checkpoint rather than a standalone adapter.

Checkpoint summary

• Architecture: Qwen3_5ForConditionalGeneration
• Parameters: 27,356,728,560
• Precision: BF16
• Format: safetensors, 12 shards
• Tensor entries: 1,184
• Tensor payload size: 54,713,457,120 bytes
• Context length used for post-training: 32,000 tokens

The checkpoint retains the image-text architecture of the base model. The post-training data focused on coding-agent interactions; multimodal quality has not been independently validated for this release.

Training summary

The model was trained for two epochs on 2,553 synthetic coding-agent SFT records. Post-training used a rank-64 LoRA with alpha 128 over linear layers, followed by consolidation with the base checkpoint. The recorded final training loss was 0.2276 at step 290. These values are included for reproducibility and do not imply downstream benchmark performance.

The synthetic dataset and reproducible training recipe are released separately from the model weights.

Usage

Use a recent Transformers release with support for the Qwen3.5/Qwen3.6 model family. Replace the placeholder with either this Hub repository ID or a local checkpoint path.

from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration

model_id = "shuaishuaicdp/Code-X-SFT-27B"

processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
    model_id,
    dtype="auto",
    device_map="auto",
)

Follow the upstream Qwen model card for message formatting, multimodal input construction, and generation examples.

Validation performed before release

• Verified that every tensor in the weight index resolves to exactly one of the 12 included shards.
• Parsed every safetensors header without loading tensor payloads.
• Matched tensor shapes, byte ranges, parameter count, and payload size to the index metadata.
• Loaded the configuration, tokenizer, and processor offline from the staged directory.
• Scanned public metadata for credentials, private filesystem paths, and local training-run identifiers.

No full benchmark table is claimed in this model card until the corresponding evaluation artifacts are packaged and independently reproducible.

Intended use and limitations

This checkpoint is intended for non-commercial research on coding agents, tool use, synthetic-data studies, and reproducible evaluation. It may produce incorrect, insecure, or destructive code. Run agents inside an isolated environment, review generated commands, and do not expose secrets or production credentials. Users are responsible for evaluating suitability, safety, and legal compliance for their own use case.

License and attribution

Release-specific modifications are provided under the Creative Commons Attribution-NonCommercial 4.0 International license in LICENSE. The checkpoint incorporates material from Qwen/Qwen3.6-27B, which is distributed under the Apache License 2.0; its license is retained in LICENSE-QWEN-APACHE-2.0. See NOTICE.md for attribution and a description of the changes. Users must comply with all applicable terms.