Downloads · 30 days
13
1% of all-time downloads
llama-deus-7b-v3-lora-merged
teknium/llama-deus-7b-v3-lora-merged
llama-deus-7b-v3-lora-merged is a text generation model from teknium. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
All-time downloads
2.4K
Public
Repo size
27 GB
Likes
17
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- May 17, 2023
- Updated
- May 17, 2023
- SHA
- d7d69a80
Try a prompt
Model card
From the Hugging Face model README
license: mit
Base Mode: Llama 7B LoRA is fully Merged with llama7b, so you do not need to merge it to load the model.
Llama DEUS v3 is the largest dataset I've trained on yet, including:
GPTeacher - General Instruct - Code Instruct - Roleplay Instruct
My unreleased Roleplay V2 Instruct
GPT4-LLM Uncensored + Unnatural Instructions
WizardLM Uncensored
CamelAI's 20k Biology, 20k Physics, 20k Chemistry, and 50k Math GPT4 Datasets
CodeAlpaca
This model was trained for 4 epochs over 1 day of training, it's a rank 128 LORA that targets attention heads, LM_Head, and MLP layers
Prompt format:
### Instruction:
<prompt>
### Response:
or
### Instruction:
<prompt>
### Input:
<input>
### Response:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- May 17, 2023
- Updated
- May 17, 2023