Downloads · 30 days
10
2% of all-time downloads
youngseok12/HyperCLOVA-X-SEED-Think-14B-success-consolidation-krc-r4min-mono
HyperCLOVA-X-SEED-Think-14B-success-consolidation-krc-r4min-mono is a text generation model from youngseok12. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repository contains a standalone BF16 model derived from naver-hyperclovax/HyperCLOVAX-SEED-Think-14B. A single LoRA adapter was trained on the combined K/R/C success-consolidation data (no per-axis LoRA, no TIES…
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
402
Public
Parameters
14.7B
29.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29.5 GB · 100%
From the Hugging Face model README
This repository contains a standalone BF16 model derived from
naver-hyperclovax/HyperCLOVAX-SEED-Think-14B.
A single LoRA adapter was trained on the combined K/R/C success-consolidation
data (no per-axis LoRA, no TIES merge) — a monolithic control arm against
HyperCLOVA-X-SEED-Think-14B-success-consolidation-krc-r4min-ties,
which trains the same data as three separate LoRAs merged with TIES. The
model name begins with HyperCLOVA X as required by the base model license.
naver-hyperclovax/HyperCLOVAX-SEED-Think-14B9b74e35d4c7e4ffec489f4171273caca8948a2b9HyperCLOVAXForCausalLMsafetensors, standalone merged full modelThe same 836 rows used to build the three axis-specific LoRAs of the TIES
sibling model, concatenated into one dataset and trained as a single LoRA.
Each row's target is the pristine base model's own correct reasoning trace
(from a free-generation pass), restructured answer-first (정답: X\n근거: ...) —
a success-consolidation (STaR-family) construction.
| Axis | Benchmark target | AI Hub source | Arm | Rows |
|---|---|---|---|---|
| K | KMMLU-Pro | 71875 (필수의료 의학지식 QA) | correct_unstable | 300 |
| R | MuSR(Ko) | 71568 (경제·스포츠 숫자연산 MRC) | correct_unstable | 236 |
| C | Com2-main(Ko) | 71949 (인과관계 기반 추론) | correct_all | 300 |
| Total | 836 |
4, alpha: 8, dropout: 0.05q_proj, v_proj only5e-5, cosine scheduler, warmup ratio 0.031, effective batch size: 16 (per-device 4 × grad accum 4)4096, loss: assistant-token-only42This capacity (rank 4, 2 target modules) was chosen because prior K-AI leaderboard submissions on this base model showed every rank-4/2-module LoRA scoring higher than every rank-16/7-module LoRA, regardless of training data — the base model is already strong, and a larger LoRA perturbation degrades it more than task-specific data helps.
Public benchmark test data was not used for training.