Downloads · 30 days
0
ChatGLM-Efficient-Tuning-SFT
Laurie/ChatGLM-Efficient-Tuning-SFT
ChatGLM-Efficient-Tuning-SFT is a machine learning model from Laurie. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Access
Public
Updated May 2, 2023
Repo size
44.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt29.4 MB · 67%
At a glance
- Access
- Public
- Created
- May 2, 2023
- Updated
- May 2, 2023
- SHA
- 6828abcc
Model card
From the Hugging Face model README
Usage
# 设置环境
git clone https://github.com/hiyouga/ChatGLM-Efficient-Tuning.git
conda create -n chatglm_etuning python=3.10
conda activate chatglm_etuning
cd ChatGLM-Efficient-Tuning
pip install -r requirements.txt
# 模型部署,新建文件夹path_to_checkpoint，下载Laurie/ChatGLM-Efficient-Tuning-SFT里的文件到里面
import sys
sys.path.append("src")
from src import load_pretrained, ModelArguments
model_args = ModelArguments(checkpoint_dir=path_to_checkpoint)
model, tokenizer = load_pretrained(model_args)
model = model.cuda()
model.eval()
# model.generate, model.chat()...
# 命令行进行测试
CUDA_VISIBLE_DEVICES=0 python src/infer.py \
--checkpoint_dir path_to_checkpoint
- Created
- May 2, 2023
- Updated
- May 2, 2023