Downloads · 30 days
5
4% of all-time downloads
ArliAI-RPMax-12B-v1.1-exl2-6.0bpw
gghfez/ArliAI-RPMax-12B-v1.1-exl2-6.0bpw
ArliAI-RPMax-12B-v1.1-exl2-6.0bpw is a machine learning model from gghfez. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
132
Public
Repo size
10 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors10 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Sep 1, 2024
- Updated
- Sep 1, 2024
- SHA
- 96a903d4
Model card
From the Hugging Face model README
ArliAI-RPMax-12B-v1.1
=====================================
Overview
This repository is based on the Mistral-Nemo-Base-2407 model and is governed by the Apache 2.0 License agreement: https://huggingface.co/mistralai/Mistral-Nemo-Base-2407
Model Description
ArliAI-RPMax-12B-v1.1 is trained on a diverse set of curated RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive, with a unique approach to training that minimizes repetition.
You can access the model at https://arliai.com and ask questions at https://www.reddit.com/r/ArliAI/
Training Details
- Sequence Length: 8192
- Training Duration: Approximately 2 days on 2x3090Ti
- Epochs: 1 epoch training for minimized repetition sickness
- QLORA: 64-rank 128-alpha, resulting in ~2% trainable weights
- Learning Rate: 0.00001
- Gradient accumulation: Very low 32 for better learning.
Quantization
The model is available in quantized formats:
- FP16: https://huggingface.co/ArliAI/ArliAI-RPMax-12B-v1.1
- GGUF: https://huggingface.co/ArliAI/ArliAI-RPMax-12B-v1.1-GGUF
Suggested Prompt Format
Mistral Instruct Prompt Format
- Type
- mistral
- License
- apache-2.0
- Created
- Sep 1, 2024
- Updated
- Sep 1, 2024