Downloads · 30 days
208
4% of all-time downloads
Bielik-11B-v2.2-Instruct-MLX-8bit
speakleash/Bielik-11B-v2.2-Instruct-MLX-8bit
Bielik-11B-v2.2-Instruct-MLX-8bit is a text generation model from speakleash. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<p align="center" <img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF/raw/main/speakleashcyfronet.png" </p
All-time downloads
4.9K
Public
Parameters
3.2B
12 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors12 GB · 100%
Parameter types
How the weights are stored.
U322.8B · 85%
Base models
Model card
From the Hugging Face model README
<p align="center">
<img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF/raw/main/speakleash_cyfronet.png">
</p>
Bielik-11B-v2.2-Instruct-MLX-8bit
This model was converted to MLX format from SpeakLeash's Bielik-11B-v.2.2-Instruct.
DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("speakleash/Bielik-11B-v2.2-Instruct-MLX-8bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Model description:
- Developed by: SpeakLeash & ACK Cyfronet AGH
- Language: Polish
- Model type: causal decoder-only
- Quant from: Bielik-11B-v2.2-Instruct
- Finetuned from: Bielik-11B-v2
- License: Apache 2.0 and Terms of Use
Responsible for model quantization
- Remigiusz Kinas<sup>SpeakLeash</sup> - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.
Contact Us
If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- pl
- Created
- Aug 26, 2024
- Updated
- Aug 28, 2024