Downloads · 30 days
8
1% of all-time downloads
krakowiak-7b
szymonrucinski/krakowiak-7b
krakowiak-7b is a machine learning model from szymonrucinski. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
<a target="blank" href="https://colab.research.google.com/github/szymonrucinski/finetune-llm/blob/main/pollamaXbinference.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/…
All-time downloads
802
Public
Repo size
1.1 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.pt269 MB · 66%
At a glance
- Library
- peft
- Access
- Public
- Created
- Jul 20, 2023
- Updated
- Jul 31, 2023
- SHA
- fec773a6
Model card
From the Hugging Face model README
<a target="_blank" href="https://colab.research.google.com/github/szymonrucinski/finetune-llm/blob/main/pollama_Xb_inference.ipynb">
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>
Introduction
Krakowiak-7B is a finetuned version of Meta's Llama2. It was trained on the modified and updated dataset originally created by Chris Ociepa containing ~ 50K instructions. Making it one of the best and biggest available LLM's. Name krakowiak refers to one of the most popular and characteristic Polish folk dances, with its very lively, even wild, tempo, and long, easy strides, demonstrating spirited abandon and elegance at the same time.
How to test it?
The model can be ran using the Huggingface library or in the browser using this Google Colab
Training procedure
Model was trained for 3 epochs, feel free to read the report
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: bfloat16
The following bitsandbytes quantization config was used during training:
- load_in_8bit: False
- load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: bfloat16
Framework versions
-
PEFT 0.4.0
-
PEFT 0.4.0
- Library
- peft
- Created
- Jul 20, 2023
- Updated
- Jul 31, 2023