Bielik-Minitron-7B-v3.0-DFlash

<p align="center"> <img src="https://huggingface.co/speakleash/Bielik-11B-v2/raw/main/speakleash_cyfronet.png"> </p>

Bielik-Minitron-7B-v3.0-DFlash

Bielik-Minitron-7B-v3.0-DFlash is a DFlash draft model designed for use with Bielik-Minitron-7B-v3.0-Instruct. Its development and training were supported by computational grant PLG/2026/019559 and carried out on the Helios supercomputer, providing access to the advanced infrastructure and computational resources required for large-scale machine learning workloads.

This is not a standalone language model. It is designed to be paired with the target model in a speculative decoding setup.

Model

The model was trained on the same training dataset as the target model, Bielik-Minitron-7B-v3.0-Instruct. Training was performed using a custom implementation built on top of the ALLaMo framework, developed by Krzysztof Ociepa.

• Developed by: SpeakLeash & ACK Cyfronet AGH
• Language: Multilingual (32 European languages, optimized for Polish)
• Model type: Draft model
• Target model: Bielik-Minitron-7B-v3.0-Instruct
• License: Apache License 2.0

Quick Start

This model should be used with an inference server that supports DFlash speculative decoding.

SGLang (version > 0.5.6):

export SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1

python -m sglang.launch_server \
    --model-path speakleash/Bielik-Minitron-7B-v3.0-Instruct \
    --speculative-algorithm DFLASH \
    --speculative-draft-model-path speakleash/Bielik-Minitron-7B-v3.0-DFlash \
    --speculative-num-draft-tokens 16

vLLM (version > 0.20.0):

vllm serve speakleash/Bielik-Minitron-7B-v3.0-Instruct \
  --speculative-config '{"method": "dflash", "model": "speakleash/Bielik-Minitron-7B-v3.0-DFlash", "num_speculative_tokens": 15}' \
  --attention-backend flash_attn \
  --max-num-batched-tokens 32768

Credits

• Krzysztof Ociepa^SpeakLeash - project lead, concept design, calibration data preparation, training pipeline development, and draft model delivery.
• Bielik-Minitron-7B-v3.0-Instruct development team:
  • Remigiusz Kinas^Bielik.AI - conceptualizing, coordinating RL trainings, data preparation, benchmarking and quantizations
  • Paweł Kiszczak^Bielik.AI - pruning and distillation supervision
  • Sergio P. Perez^NVIDIA - conceptualizing, benchmarking and quantizations
  • Krzysztof Ociepa^Bielik.AI - team leadership, conceptualizing, data preparation, process optimization and oversight of training
  • Łukasz Flis^{Cyfronet AGH} - coordinating and supervising the training
  • Adrian Gwoździej^Bielik.AI - data preparation and ensuring data quality
  • Krzysztof Wróbel^Bielik.AI - benchmarks

The model could not have been created without the commitment and work of the entire SpeakLeash team, whose contribution is invaluable. Thanks to the hard work of many individuals, it was possible to gather a large amount of content in Polish and establish collaboration between the open-science SpeakLeash project and the HPC center: ACK Cyfronet AGH. Individuals who contributed to the creation of the model: Sebastian Kondracki, Marek Magryś, Sonia Staniek, Waldemar Boszko, Igor Ciuciura.

We gratefully acknowledge Polish high-performance computing infrastructure PLGrid (HPC Center: ACK Cyfronet AGH) for providing computer facilities and support within computational grant no. PLG/2026/019559.

Citation

Please cite this model using the following format:

@misc{ociepa2025bielik11bv3multilingual,
      title={Bielik 11B v3: Multilingual Large Language Model for European Languages}, 
      author={Krzysztof Ociepa and Łukasz Flis and Remigiusz Kinas and Krzysztof Wróbel and Adrian Gwoździej},
      year={2025},
      eprint={2601.11579},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2601.11579}, 
}
@misc{BielikMinitron7Bv3dflash,
    title     = {Bielik-Minitron-7B-v3.0-DFlash model card},
    author    = {Ociepa, Krzysztof and Flis, Łukasz and Kinas, Remigiusz and Gwoździej, Adrian and Wróbel, Krzysztof and {SpeakLeash Team} and {Cyfronet Team}},
    year      = {2026},
    url       = {https://huggingface.co/speakleash/Bielik-Minitron-7B-v3.0-DFlash},
    note      = {Accessed: 2026-06-24}, % change this date
    urldate   = {2026-06-24} % change this date
}

Contact Us

If you have any questions, suggestions, or feedback, please use the Discussions tab on Hugging Face. For direct communication, join the SpeakLeash Discord server or connect with the Bielik team on LinkedIn.