Downloads · 30 days
110
7% of all-time downloads
Bielik-11B-v2.2-Instruct-MLX-4bit
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Bielik-11B-v2.2-Instruct-MLX-4bit is a text generation model from speakleash. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<p align="center" <img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF/raw/main/speakleashcyfronet.png" </p
All-time downloads
1.7K
Public
Parameters
1.9B
6.5 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors6.5 GB · 100%
Parameter types
How the weights are stored.
U321.4B · 74%
Base models
Model card
From the Hugging Face model README
<p align="center">
<img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF/raw/main/speakleash_cyfronet.png">
</p>
Bielik-11B-v2.2-Instruct-MLX-4bit
This model was converted to MLX format from SpeakLeash's Bielik-11B-v.2.2-Instruct.
DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Model description:
- Developed by: SpeakLeash & ACK Cyfronet AGH
- Language: Polish
- Model type: causal decoder-only
- Quant from: Bielik-11B-v2.2-Instruct
- Finetuned from: Bielik-11B-v2
- License: Apache 2.0 and Terms of Use
Responsible for model quantization
- Remigiusz Kinas<sup>SpeakLeash</sup> - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.
Contact Us
If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- pl
- Created
- Aug 26, 2024
- Updated
- Aug 28, 2024