Downloads · 30 days
50
0% of all-time downloads
Mistral-7B-AEZAKMI-v1
adamo1139/Mistral-7B-AEZAKMI-v1
Mistral-7B-AEZAKMI-v1 is a text generation model from adamo1139. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Mistral 7B model fine-tuned on AEZAKMI v1 dataset that is derived from airoboros 2.2.1 and airoboros 2.2. Finetuned with axolotl, using qlora and nf4 double quant, around 2 epochs, batch size 8, lr 0.00008, lr schedul…
All-time downloads
35.6K
Public
Parameters
7.2B
14.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- Nov 27, 2023
- Updated
- Nov 29, 2023
- SHA
- fec4e695
Try a prompt
Model card
From the Hugging Face model README
Mistral 7B model fine-tuned on AEZAKMI v1 dataset that is derived from airoboros 2.2.1 and airoboros 2.2. Finetuned with axolotl, using qlora and nf4 double quant, around 2 epochs, batch size 8, lr 0.00008, lr scheduler cosine. Scheduled training was 5 epochs, but loss seemed fine after 2 so I finished it quicker. Training took around 10 hours on single RTX 3090 Ti.
Main feature of this model is that it's output is free of refusals and it feels somehow more natural. Prompt format is standard chatml. Don't expect it to be good at math, riddles or be crazy smart. My end goal with AEZAKMI is to create a cozy free chatbot.
Not sure what license it needs to have, given license of airoboros dataset. I'll leave it as other for now.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- other
- Created
- Nov 27, 2023
- Updated
- Nov 29, 2023