Downloads · 30 days
0
chinese-kenlm-klm
shibing624/chinese-kenlm-klm
chinese-kenlm-klm is a machine learning model from shibing624. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as bigscience-bloom-rail-1.0.
Access
Public
Updated Nov 8, 2023
Repo size
3.1 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.klm3.1 GB · 100%
At a glance
- License
- bigscience-bloom-rail-1.0
- Access
- Public
- Created
- Nov 8, 2023
- Updated
- Nov 8, 2023
- SHA
- 8c30ebb3
Try a prompt
Model card
From the Hugging Face model README
Chinese language Model(kenlm)
kenlm language model:
- big model: zh_giga.no_cna_cmn.prune01244.klm
- small model: people2014corpus_chars.klm
Usage
本项目开源在 pycorrector 项目：pycorrector，可支持kenlm模型，通过如下命令调用：
Install package:
pip install -U pycorrector
from pycorrector import Corrector
model = Corrector(language_model_path='people2014corpus_chars.klm')
print(model.correct('少先队员因该为老人让坐')) # ['少先队员应该为老人让座。']
如果需要训练文本纠错模型，请参考https://github.com/shibing624/pycorrector
Citation
@software{pycorrector,
author = {Ming Xu},
title = {pycorrector: Text Error Correction Tool},
year = {2023},
url = {https://github.com/shibing624/pycorrector},
}
- License
- bigscience-bloom-rail-1.0
- Languages
- zh
- Created
- Nov 8, 2023
- Updated
- Nov 8, 2023