Downloads · 30 days
8
4% of all-time downloads
baseline-model-instruct-8k-yarn
ft-llm-team-mkj/baseline-model-instruct-8k-yarn
baseline-model-instruct-8k-yarn is a machine learning model from ft-llm-team-mkj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This model is ft-llm-team-mkj/baseline-model-instruct with YaRN (Yet another RoPE extensioN) applied to extend the context window.
All-time downloads
222
Public
Parameters
8.6B
17.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.2 GB · 100%
At a glance
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Dec 16, 2025
- Updated
- Dec 16, 2025
- SHA
- 9b059d91
Base models
Model card
From the Hugging Face model README
baseline-model-instruct-8k-yarn
This model is ft-llm-team-mkj/baseline-model-instruct with YaRN (Yet another RoPE extensioN) applied to extend the context window.
Model Details
- Base Model: ft-llm-team-mkj/baseline-model-instruct
- Original Context Length: 4096 tokens
- Extended Context Length: 8192 tokens
- Extension Method: YaRN
- Scaling Factor: 2.0
YaRN Configuration
{
"rope_type": "yarn",
"factor": 2.0,
"original_max_position_embeddings": 4096,
"beta_fast": 32,
"beta_slow": 1
}
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"DeL-TaiseiOzaki/baseline-model-instruct-8k-yarn",
torch_dtype="bfloat16",
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("DeL-TaiseiOzaki/baseline-model-instruct-8k-yarn")
Note
This model has YaRN applied but has not been fine-tuned on long-context data yet. For optimal performance on long sequences, fine-tuning on long documents is recommended.
References
- Type
- llama
- License
- other
- Created
- Dec 16, 2025
- Updated
- Dec 16, 2025