MIST-Mini-8B

MIST-1-8B

MIST-1-8B (formerly MIST-Mini) is the smallest and fastest model in the MIST model family by olaverse. Built by blending 4 specialized Llama 3.1 8B models using DARE+TIES — delivering strong performance at maximum speed. fast, thorough, great for everyday use

MIST Model Family

---

Key Strengths

• ⚡ Fastest — 63 tok/s on H200, great for real-time applications
• 🧠 Strong Reasoning — DeepSeek R1 distillation
• 💻 Clean Code — production-ready with comments
• 📐 Math — accurate step-by-step solving
• 🤝 Helpful — low refusal rate
• 📦 Lightweight — 15GB, runs on consumer GPUs

---

Benchmark Results

Average: 63 tok/s

---

How to Use

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "olaverse/MIST-Mini-8B",
    torch_dtype="auto",
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("olaverse/MIST-Mini-8B")

messages = [{"role": "user", "content": "Your question here"}]
text = tokenizer.apply_chat_template(
    messages, tokenize=False, add_generation_prompt=True
)
inputs = tokenizer(text, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Hardware Requirements

---

Recommended Generation Settings

These settings were verified through testing. Without repetition_penalty and min_p the model will ramble and not stop cleanly.

outputs = model.generate(
    **inputs,
    max_new_tokens=1024,
    do_sample=True,
    temperature=0.7,
    top_p=0.95,
    min_p=0.05,
    repetition_penalty=1.5,
    eos_token_id=[128040, 128009, 128001],
    pad_token_id=128001,
)

Stop Tokens

This model's ChatML parents (<|im_end|>) survived the DARE+TIES merge alongside Llama 3.1 native tokens. Use all three:

License

Llama 3.1 Community License