Downloads · 30 days
17
5% of all-time downloads
speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ
Bielik-7B-Instruct-v0.1-3bit-HQQ is a text generation model from speakleash. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
<p align="center" <img src="https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1/raw/main/speakleashcyfronet.png" </p
Downloads · 30 days
17
5% of all-time downloads
All-time downloads
374
Public
Repo size
3.5 GB
Likes
1
Public
Click a slice to open those files.
.pt3.5 GB · 100%
From the Hugging Face model README
This repo contains HQQ (3-bit) format model files for SpeakLeash's Bielik-7B-Instruct-v0.1.
<b><u>DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!</u></b><br>
Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing
If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.