orkhon-tegin

Orkhon / tegin

22M unified assistant tuned from the former Kultegin instruct model.

This repository is one member of the Orkhon model family, an auditable from-scratch LLM stack covering tokenizer, pretraining, post-training, evaluation, serving, and Hugging Face export.

• Family: Orkhon
• Member: tegin
• Kind: instruct
• Interface: chat
• Parameters: ~21.9M
• Source code: https://github.com/UmutKorkmaz/orkhon
• Local model-zoo folder: models/tegin-20260620

Family Context

Members without archived local weights are skipped by the preparation script.

Intended Use

• Inspecting and reproducing the Orkhon training/export path.
• Running small local demos on CPU/MPS/CUDA.
• Comparing Orkhon family members by training stage and data mix.
• Rune-to-Latin Old Turkic transliteration demos.

Not Intended For

• Reliable factual QA.
• Safety-critical decisions.
• Claims of state-of-the-art Turkish or general LLM performance.
• Treating Old Turkic transliteration as modern Turkish translation.

Evaluation

Current benchmark reports in the source repo are smoke baselines unless marked otherwise. Do not treat limit-20 benchmark runs as headline capability claims.

Example Prompt

Do not write a story. What can you help me with?

Usage

Install Orkhon from the source repo, then load this exported folder:

pip install git+https://github.com/UmutKorkmaz/orkhon

from huggingface_hub import snapshot_download
from orkhon.export.to_hf import load_exported_model
from orkhon.tokenizer import load_tokenizer

path = snapshot_download("korkmazumut/orkhon-tegin")
model, cfg = load_exported_model(path, device="cpu")
tok = load_tokenizer(path)

Use orkhon.serve.chat_cli.reply for the unified assistant members.

Files

• model.safetensors - exported inference weights
• config.json - Orkhon architecture config
• tokenizer.json, tokenizer_config.json, special_tokens_map.json
• manifest.json - model-zoo metadata from the source repo
• samples.txt - saved local samples when available
• orkhon_model_card.md - original local model card

Limitations

This is a small research/education model family. The models can repeat, confabulate, and fail outside their narrow data scale. Public demos should keep the claim narrow: Orkhon is an auditable from-scratch stack with a Turkic branch, not a frontier assistant.