Downloads · 30 days
282
25% of all-time downloads
mmis1000/asmr-qwen3.5-9b-zh-cn-gguf-v0.2
asmr-qwen3.5-9b-zh-cn-gguf-v0.2 is a text generation model from mmis1000. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantizations of a fine-tuned model for translating Japanese ASMR transcriptions (ASR/Whisper output) into Simplified Chinese.
Downloads · 30 days
282
25% of all-time downloads
All-time downloads
1.1K
Public
Repo size
82 GB
Likes
0
Public
Click a slice to open those files.
.gguf41.5 GB · 100%
From the Hugging Face model README
GGUF quantizations of a fine-tuned model for translating Japanese ASMR transcriptions (ASR/Whisper output) into Simplified Chinese.
The model normalizes imperfect audio transcriptions, applies domain-specific glossaries, and translates character dialogue while retaining emotion and nuances.
This variant preserves the upstream Qwen3.5 MTP / speculative-decoding head in GGUF format so it can be used with MTP-capable llama.cpp builds.
The traditional output format where only the translated text is returned.
| Quantization | Filename | Size | Description |
|---|---|---|---|
| q4_k_m | asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q4_k_m.gguf | 5.4 GB | Good balance of quality and size |
| q6_k | asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q6_k.gguf | 7.0 GB | Higher quality, moderate size |
| q8_0 | asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q8_0.gguf | 9.1 GB | Near-lossless quality |
| bf16 | asmr-qwen3.5-9b-zh-cn-gguf-v0.2-bf16.gguf | 17.1 GB | Full BF16, no quantization loss |
将以下日语ASMR逐字稿翻译成简体中文。
音轨:track01_示例音轨
场景说明:主角与青梅竹马在校园下午的对话...
术语表(请严格使用zh栏位的译名):
{
"cvs": [],
"characters": [],
"terms": [{"ja": "放課後", "zh": "放学后"}]
}
翻译前请静默修正以下Whisper识别错误:
- 重复片语(连续3次以上且无变化):仅保留一次
- 错字/同音异字:依上下文修正
- 字幕版权行(字幕:/翻訳:/QQ/LINE水印):text设为null
- 错误专有名词:依术语表修正
翻译规则:
- 呻吟与气息声(あ、ん、はあ)→ 自然对应(啊、嗯、哈、呼)
- 拟声词:日语形式翻译(パンパン→啪啪);中文形式保留原样
- 保留角色语气与口吻
- text字段只输出译文,不加注释或括号说明
输入:逐字稿JSON数组 — {"id": <n>, "text": "<日文>", "start": <ms>, "end": <ms>}
输出:将连续构成同一句话的片段合并,JSON数组格式:
{"ids": [<n>, ...], "text": "<简体中文>", "start": <最早ms>, "end": <最晚ms>}
字幕版权行:{"ids": [<n>], "text": null, "start": <ms>, "end": <ms>}
每个输入id必须恰好出现在一个输出项中。
逐字稿:
[
{"id": 1, "text": "ねぇ、放課後、", "start": 3000, "end": 5000},
{"id": 2, "text": "一緒に帰らない?", "start": 5000, "end": 7000}
]
Example Output:
[{"ids": [1, 2], "text": "呐,放学后,要不要一起回去?", "start": 3000, "end": 7000}]
llama-server -m asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q4_k_m.gguf -c 8192 --port 8080
llama-cli -m asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q4_k_m.gguf -c 8192 -p "<your prompt>" -n 2048
llama-cli -m asmr-qwen3.5-9b-zh-cn-gguf-v0.2-q4_k_m.gguf -c 8192 --spec-type draft-mtp --spec-draft-n-max 6 -p "<your prompt>" -n 2048
This model outputs JSON arrays. Using structured decoding (e.g. GBNF grammar or JSON schema constraints) avoids wasted computation on malformed output and guarantees valid JSON on every generation.
JSON Schema:
{
"type": "array",
"items": {
"type": "object",
"properties": {
"ids": {
"type": "array",
"items": {
"type": "integer"
},
"minItems": 1
},
"text": {
"anyOf": [
{
"type": "string"
},
{
"type": "null"
}
]
},
"start": {
"type": "integer"
},
"end": {
"type": "integer"
}
},
"required": [
"ids",
"text",
"start",
"end"
],
"additionalProperties": false
},
"minItems": 1
}
Supported by llama.cpp (--json-schema), vLLM, and outlines.
unsloth/Qwen3.5-9BThis release continues the v0.1 Simplified Chinese standard adapter directly to a maximum training sequence length of 8,192 tokens. It does not stack adapters and does not use RoPE scaling or YaRN.
The deterministic continuation consumed 800 training draws: 520 coherent same-track, 120 far-context/glossary-recall, and 160 ordinary replay draws. The published adapter reached absolute step 200. Adapter weights SHA-256: 78d239dcde5030af979030ef5ea5e7d515638b1f46117fae9934f9a184c7ec59.
Pinned base revision: 005429cee5cb648998cf2b70eebdd83175989c9a.
This variant received a small held-out semantic check rather than the full 200-row matrix: three ordinary rows and three long rows, each from a distinct locked-test family and with zero source overlap with the continuation ledger. All six grammar-constrained Q8 requests completed with exact ID coverage.
Manual reading found five of six rows semantically usable. The strongest long rows preserved coherent scene progression over 60+ source segments. The single failed row contained catastrophically corrupted source ASR, including eight repeated おやすみなさい segments; both model output and reference contained content unsupported by the literal source.
8192 is the total runtime context, not a safe input-only budget. Reserve room for generated JSON. Corrupted or repetitive ASR should be split into shorter windows rather than concatenated to the limit.
zh-tw-echo.The training domain includes adult ASMR dialogue and may produce sexually explicit text. This model is intended for transcription translation and subtitle-processing workflows.
This revision preserves and verifies all 15 upstream MTP tensors against the pinned base checkpoint after the LoRA merge. The native-8192 adapter is unchanged; no retraining was performed. The MTP head itself is not fine-tuned. Earlier revisions of this v0.2 repository omitted MTP. Filenames and translation weights remain compatible; use a fresh repository revision to avoid cached non-MTP files. All four quantizations have verified MTP metadata and tensor inventory. Q4_K_M was GPU-smoke-tested with llama.cpp b9247, context 8192, and --spec-type draft-mtp --spec-draft-n-max 3. This is a runtime smoke test, not a new quality evaluation or a speedup guarantee. See mtp-preservation.json and mtp-release-verification.json for provenance and checks.