Downloads · 30 days
16
3% of all-time downloads
youngseok12/HyperCLOVA-X-SEED-Think-14B-minimal-sft-71875-71949-correct-540
HyperCLOVA-X-SEED-Think-14B-minimal-sft-71875-71949-correct-540 is a text generation model from youngseok12. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repository contains a standalone BF16 model created by continuing the Minimal SFT model youngseok12/HyperCLOVA-X-SEED-Think-14B-minimal-sft-71875 with a small correct-only LoRA on AI Hub 71949 data.
Downloads · 30 days
16
3% of all-time downloads
All-time downloads
505
Public
Parameters
14.7B
29.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29.5 GB · 100%
From the Hugging Face model README
This repository contains a standalone BF16 model created by continuing the
Minimal SFT model
youngseok12/HyperCLOVA-X-SEED-Think-14B-minimal-sft-71875
with a small correct-only LoRA on AI Hub 71949 data.
The direct starting checkpoint was the locally verified merged Minimal SFT
model. Its original foundation is
naver-hyperclovax/HyperCLOVAX-SEED-Think-14B, revision
9b74e35d4c7e4ffec489f4171273caca8948a2b9.
A/B/C/D29791fa19d412d3c48d7080381079ab3ccf3190059a5ba04e94be37f479feef8The same low-impact Minimal SFT recipe was used:
4, alpha 8, dropout 0q_proj, v_proj1e-6, constant scheduler, no warmup, weight decay 010241, gradient accumulation 1634 optimizer steps42The final train loss was 3.9535395538. The adapter was merged into the
Minimal SFT checkpoint using BF16 safetensors.
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "youngseok12/HyperCLOVA-X-SEED-Think-14B-minimal-sft-71875-71949-correct-540"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)
This derivative model is subject to the HyperCLOVA X SEED 14B Think Model
License Agreement in LICENSE, with the required attribution in NOTICE.
AI Hub source-data terms also apply. This is an experimental research and
evaluation model; outputs may be incorrect and it is not a substitute for
professional medical, legal, financial, or other advice.