Downloads · 30 days
3
12% of all-time downloads
yihao-ai/yihao-llm-14b-v2
yihao-llm-14b-v2 is a machine learning model from yihao-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
「移号(Yihao)」企业级大模型(14B),基于 Qwen/Qwen2.5-14B-Instruct 使用 QLoRA 行为对齐并合并权重,主要增强:
Downloads · 30 days
3
12% of all-time downloads
All-time downloads
25
Public
Parameters
14.8B
29.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29.5 GB · 100%
From the Hugging Face model README
「移号(Yihao)」企业级大模型(14B),基于 Qwen/Qwen2.5-14B-Instruct 使用 QLoRA 行为对齐并合并权重,主要增强:
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "yihao-ai/yihao-llm-14b-v2"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
trust_remote_code=True,
)
prompt = "你是谁?一句话介绍你的定位。"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))