Downloads · 30 days
5
10% of all-time downloads
IceCocoaRP-7b-6.5bpw-exl2
icefog72/IceCocoaRP-7b-6.5bpw-exl2
IceCocoaRP-7b-6.5bpw-exl2 is a text generation model from icefog72. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
6.5bpw-exl2 quant of icefog72/IceCocoaRP-7b
All-time downloads
52
Public
Repo size
6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- mistral
- Access
- Public
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024
- SHA
- 7a3fe80f
Try a prompt
Model card
From the Hugging Face model README
IceCocoaRP-7b-6.5bpw-exl2
6.5bpw-exl2 quant of icefog72/IceCocoaRP-7b
Rules-lorebook and settings I'm using you can find here
Merge Details
The best one so far for me.
Merge Method
This model was merged using the TIES merge method using NeuralBeagleJaskier as a base.
Models Merged
The following models were included in the merge:
- NeuralBeagleJaskier
- IceBlendedCoffeeRP-7b (slerp bfloat16)
- IceCoffeeRP-7b
- IceBlendedLatteRP-7b base
Configuration
The following YAML configuration was used to produce this model:
models:
- model: NeuralBeagleJaskier
parameters:
density: 0.9
weight: 0.5
- model: IceBlendedCoffeeRP-7b
parameters:
density: 0.5
weight: 0.3
merge_method: ties
base_model: NeuralBeagleJaskier
parameters:
normalize: true
int8_mask: true
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc-by-nc-4.0
- Created
- Jun 12, 2024
- Updated
- Jun 12, 2024