Downloads · 30 days
32
7% of all-time downloads
llama2_7b_openorca_35k
georgesung/llama2_7b_openorca_35k
llama2_7b_openorca_35k is a text generation model from georgesung. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Fine-tuned Llama-2 7B with a 35k subset of the OpenOrca dataset georgesung/OpenOrca35k. Used QLoRA for fine-tuning. Trained for one epoch on a 24GB GPU (NVIDIA A10G) instance.
All-time downloads
469
Public
Parameters
6.7B
53.9 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin27 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Aug 9, 2023
- Updated
- Jun 22, 2026
- SHA
- b3a16b53
Try a prompt
Datasets
Model card
From the Hugging Face model README
Overview
Fine-tuned Llama-2 7B with a 35k subset of the OpenOrca dataset georgesung/OpenOrca_35k. Used QLoRA for fine-tuning. Trained for one epoch on a 24GB GPU (NVIDIA A10G) instance.
Prompt style
The model was trained with the following prompt style:
### System:
You are a helpful AI assistant.
### Instruction:
Hello
### Response:
Hi, how can I help you?
Training code
Code used to train the model is available here.
To reproduce the results:
git clone https://github.com/georgesung/llm_qlora
cd llm_qlora
pip install -r requirements.txt
python train.py configs/llama2_7b_orca_35k.yaml
Fine-tuning guide
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Created
- Aug 9, 2023
- Updated
- Jun 22, 2026