Downloads · 30 days
10
5% of all-time downloads
Yvthyvq/Liujgoj-Cantonese-gemma-4-12B-it-cpt
Liujgoj-Cantonese-gemma-4-12B-it-cpt is a text generation model from Yvthyvq. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
本模型係基於 Google 嘅 google/gemma-4-12B-it 進行 CPT (Continual Pre-Training) 嘅粵語羅馬字增強版本。
Downloads · 30 days
10
5% of all-time downloads
All-time downloads
222
Public
Parameters
12B
24 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24 GB · 100%
From the Hugging Face model README
本模型係基於 Google 嘅 google/gemma-4-12B-it 進行 CPT (Continual Pre-Training) 嘅粵語羅馬字增強版本。
透過 CPT 技術,我哋為模型注入咗 粵語音節知識 同 16 個特殊 XML 標籤,令模型能夠更準確噉理解同生成粵語羅馬字(Jyutping)。
| 標籤 | 用途 |
|---|---|
<ipa-lexicon_BLOCK> </ipa-lexicon_BLOCK> | IPA 詞條區塊 |
<ipa-syllable_BLOCK> </ipa-syllable_BLOCK> | IPA 音節區塊 |
<lexicon-ipa_BLOCK> </lexicon-ipa_BLOCK> | 詞條轉 IPA 區塊 |
<lexicon-syllable_BLOCK> </lexicon-syllable_BLOCK> | 詞條轉音節區塊 |
<syllable-ipa_BLOCK> </syllable-ipa_BLOCK> | 音節轉 IPA 區塊 |
<syllable-lexicon_BLOCK> </syllable-lexicon_BLOCK> | 音節轉詞條區塊 |
<SCENE> </SCENE> | 對話場景區塊 |
<LEX_BLOCK> </LEX_BLOCK> | 詞條解釋區塊 |
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_path = "Yvthyvq/Liujgoj-Cantonese-gemma-4-12B-it-cpt"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
model_path,
torch_dtype=torch.bfloat16,
device_map="auto"
)
本模型在增量預訓練(CPT)部分使用了 OpenCSG/Fineweb-Edu-Chinese 數據集。在此特別感謝 OpenCSG 開源社區提供的優質教育語料。本模型的衍生、分發與使用將嚴格遵循 OpenCSG 模型社區許可協議。
Part of the continued pre-training (CPT) data used in this model is derived from the HuggingFaceFW/fineweb-edu dataset. We are grateful to the Hugging Face vLLM/FW team for providing this high-quality dataset under the MIT license.