Downloads · 30 days
9
2% of all-time downloads
ganscs/Qwen3-8b-qwen-h100-20260909-CPT-merged-step-750
Qwen3-8b-qwen-h100-20260909-CPT-merged-step-750 is a text generation model from ganscs. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Standalone BF16 model combining Qwen/Qwen3-8B-Base with the trained LoRA adapter and full embedding/output weights from checkpoint 750. Load this repository directly with Transformers; a separate PEFT adapter is not r…
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
441
Public
Parameters
8.2B
16.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
Standalone BF16 model combining Qwen/Qwen3-8B-Base with the trained
LoRA adapter and full embedding/output weights from checkpoint 750.
Load this repository directly with Transformers; a separate PEFT adapter is not required.
49e3418fbbbca6ecbdf9608b4d22e5a407081db4.1586e45fc7c3f7d5e601dc454ba7e15884a2f1df.embed_tokens and lm_head weights replace the original endpoints.Adapters were trained with a 4-bit base. This export merges them into the original BF16 base revision using PEFT's safe merge operation. The training-time validation score above is not a new evaluation of this BF16 export.
Every adapter tensor was consumed; all output tensors are finite and match the
Transformers architecture's names and shapes. The model loaded locally without
PEFT adapters and produced finite logits and a short greedy generation.
merge_manifest.json records source hashes, merge details and output checksums;
validation.json records the smoke test. training_manifest.json preserves
the source experiment settings. This is a weights-only export, without optimizer state.
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "ganscs/Qwen3-8b-qwen-h100-20260909-CPT-merged-step-750"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id, dtype=torch.bfloat16, device_map="auto"
)