Downloads · 30 days
12
24% of all-time downloads
miiqu-exl2
Infinimol/miiqu-exl2
miiqu-exl2 is a text generation model from Infinimol. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
All-time downloads
51
Public
Parameters
14.3B
56.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors56.7 GB · 100%
Parameter types
How the weights are stored.
I3214B · 98%
Try a prompt
Model card
From the Hugging Face model README
miiqu-105b-v1.0
Developed by Infinimol AI GmbH
Also Available:
8th place on EQ-Bench, beating Qwen1.5-72B-Chat, miqudev/miqu-1-70b, mistral-medium and claude-3-sonnet-20240229. All without fine-tuning or additional training.
Thanks for support from: turboderp, silphendio, sqrkl, and ngxson!
Model Details
- Max Context: 32768 tokens
- Layers: 105
Prompt template: ChatML or Mistral
chatml:
<|im_start|><|user|>\n<|user-message|><|im_end|>\n<|im_start|><|bot|>\n<|bot-message|><|im_end|>\n
mistral:
[INST] <|user|><|user-message|>[/INST]<|bot|><|bot-message|></s>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- other
- Languages
- en, de, fr, es, it
- Created
- Mar 15, 2024
- Updated
- Mar 20, 2024