Downloads · 30 days
6
10% of all-time downloads
InfinityRP-v2-8B-6.5bpw-h8-exl2
Meggido/InfinityRP-v2-8B-6.5bpw-h8-exl2
InfinityRP-v2-8B-6.5bpw-h8-exl2 is a text generation model from Meggido. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
[!note] ➡️ Exl2 version : 0.0.20<br/ ➡️ Cal. dataset : Default. <figure <img width="20%" src="https://cdn-uploads.huggingface.co/production/uploads/6512562f8c0f10eedb1c64d7/O-ZN2wA0JrG6RcXkp6hn.gif"</img <figcaptionFo…
All-time downloads
60
Public
Repo size
7.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 7, 2024
- Updated
- May 10, 2024
- SHA
- 3420d07f
Try a prompt
Model card
From the Hugging Face model README
⚡ExLlamaV2 quant of : InfinityRP-v2-8B
<figure> <img width="20%" src="https://cdn-uploads.huggingface.co/production/uploads/6512562f8c0f10eedb1c64d7/O_-ZN2wA0JrG6RcXkp6hn.gif"></img> <figcaption>Forgot to save the measurement file...</figcaption> </figure>[!note] ➡️ Exl2 version : 0.0.20<br/> ➡️ Cal. dataset : Default.
The idea is the same as InfinityRP v1, but this one is Llama 3 with 16k ctx! Have fun...
Prompt format: Alpaca.
"You are now in roleplay chat mode. Engage in an endless chat, always with a creative response. Follow lengths very precisely and create paragraphs accurately. Always wait your turn, next actions and responses. Your internal thoughts are wrapped with ` marks."
User Message Prefix = ### Input:
Assistant Message Prefix = ### Response:
System Message Prefix = ### Instruction:
Turn on "Include Names" (optional)
Text Length: (use on your System Prompt or ### Response:)
Response: (length = medium) <- [tiny, micro, short, medium, long, enormous, huge, massive, humongous]
Example:
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- May 7, 2024
- Updated
- May 10, 2024