Downloads · 30 days
22
24% of all-time downloads
Mistral-11B-CC-Air-RP
Undi95/Mistral-11B-CC-Air-RP
Mistral-11B-CC-Air-RP is a text generation model from Undi95. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
CollectiveCognition-v1.1-Mistral-7B and airoboros-mistral2.2-7b glued together and finetuned with qlora of Pippa and LimaRPv3 dataset.
All-time downloads
90
Public
Repo size
21.5 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.bin21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- mistral
- Access
- Public
- Created
- Oct 9, 2023
- Updated
- Oct 9, 2023
- SHA
- 24b274bc
Try a prompt
Model card
From the Hugging Face model README
CollectiveCognition-v1.1-Mistral-7B and airoboros-mistral2.2-7b glued together and finetuned with qlora of Pippa and LimaRPv3 dataset.
<!-- description start -->Description
This repo contains fp16 files of Mistral-11B-CC-Air-RP.
<!-- description end --> <!-- description start -->Model used
- CollectiveCognition-v1.1-Mistral-7B
- airoboros-mistral2.2-7b
- PIPPA dataset 11B qlora
- LimaRPv3 dataset 11B qlora
Prompt template: Alpaca or default
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
USER: <prompt>
ASSISTANT:
The secret sauce
slices:
- sources:
- model: teknium/CollectiveCognition-v1.1-Mistral-7B
layer_range: [0, 24]
- sources:
- model: teknium/airoboros-mistral2.2-7b
layer_range: [8, 32]
merge_method: passthrough
dtype: float16
Special thanks to Sushi.
If you want to support me, you can here.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc-by-nc-4.0
- Created
- Oct 9, 2023
- Updated
- Oct 9, 2023