Downloads · 30 days
13
25% of all-time downloads
InfinityRP-v2-8B-8bpw-h8-exl2
JayhC/InfinityRP-v2-8B-8bpw-h8-exl2
InfinityRP-v2-8B-8bpw-h8-exl2 is a text generation model from JayhC. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<br/<br/ 8bpw/h8 exl2 quantization of Endevor/InfinityRP-v2-8B using default exllamav2 calibration dataset.
All-time downloads
52
Public
Repo size
8.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 3, 2024
- Updated
- May 3, 2024
- SHA
- b3167999
Try a prompt
Model card
From the Hugging Face model README
<br/><br/> 8bpw/h8 exl2 quantization of Endevor/InfinityRP-v2-8B using default exllamav2 calibration dataset.
ORIGINAL CARD:
The idea is the same as InfinityRP v1, but this one is Llama 3 with 16k ctx! Have fun...
Prompt format: Alpaca.
"You are now in roleplay chat mode. Engage in an endless chat, always with a creative response. Follow lengths very precisely and create paragraphs accurately. Always wait your turn, next actions and responses. Your internal thoughts are wrapped with ` marks."
User Message Prefix = ### Input:
Assistant Message Prefix = ### Response:
System Message Prefix = ### Instruction:
Turn on "Include Names" (optional)
Text Length: (use on your System Prompt or ### Response:)
Response: (length = medium) <- [tiny, micro, short, medium, long, enormous, huge, massive, humongous]
Example:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- May 3, 2024
- Updated
- May 3, 2024