Downloads · 30 days
0
rmihaylov/alpaca-lora-bg-7b
alpaca-lora-bg-7b is a machine learning model from rmihaylov. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This repo contains a low-rank adapter for LLaMA-7b trained on Bulgarian dataset.
Downloads · 30 days
0
Access
Public
Updated Apr 14, 2023
Repo size
67.2 MB
Likes
1
Public
Click a slice to open those files.
.bin67.2 MB · 100%
From the Hugging Face model README
This repo contains a low-rank adapter for LLaMA-7b trained on Bulgarian dataset.
This model was introduced in this paper.
The training data is private Bulgarian dataset.
This is an instruction-based model similart to ChatGPT but in Bulgarian.
Here is how to use this model in PyTorch:
>>> git clone https://github.com/tloen/alpaca-lora.git
>>> cd alpaca-lora
>>> pip install -r requirements.txt
>>>
>>> python generate.py \
--load_8bit \
--base_model 'yahma/llama-7b-hf' \
--lora_weights 'rmihaylov/alpaca-lora-bg-7b' \
--share_gradio
This will download both a base model and an adapter from huggingface. Then it will run a gradio interface for chatting.
Example using this model: Colab. You need a Colab Pro because the model needs high ram when loading.
