Downloads · 30 days
0
genkidakun_202407
genkida/genkidakun_202407
genkidakun_202407 is a machine learning model from genkida. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
import torch from peft import PeftModel, PeftConfig from transformers import AutoModelForCausalLM, AutoTokenizer
Access
Public
Updated Jul 14, 2024
Repo size
20.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.5 MB · 86%
At a glance
- Access
- Public
- Created
- Jul 13, 2024
- Updated
- Jul 14, 2024
- SHA
- fdd05ffb
Spaces
Model card
From the Hugging Face model README
import torch from peft import PeftModel, PeftConfig from transformers import AutoModelForCausalLM, AutoTokenizer
peft_model_id = "genkida/genkidakun_202407" config = PeftConfig.from_pretrained(peft_model_id)
ベースモデルの準備
base_model = AutoModelForCausalLM.from_pretrained( config.base_model_name_or_path, load_in_4bit=True, device_map="auto") tokenizer = AutoTokenizer.from_pretrained(config.base_model_name_or_path)
LoRAモデルのロード
model = PeftModel.from_pretrained( base_model, peft_model_id, state_dict=base_model.state_dict(), device_map="auto", torch_dtype=torch.float16) model.eval()
- Created
- Jul 13, 2024
- Updated
- Jul 14, 2024