Downloads · 30 days
16
0% of all-time downloads
Midnight-Miqu-70B-v1.5-4bit
cecibas/Midnight-Miqu-70B-v1.5-4bit
Midnight-Miqu-70B-v1.5-4bit is a text generation model from cecibas. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as unknown.
All-time downloads
3.8M
Public
Repo size
73.4 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin36.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- unknown
- Model type
- llama
- Access
- Public
- Created
- Jun 7, 2024
- Updated
- Jun 7, 2024
- SHA
- 8bd8b191
Try a prompt
Model card
From the Hugging Face model README
awq quant made with lmdeploy v0.4.2:
lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- unknown
- Created
- Jun 7, 2024
- Updated
- Jun 7, 2024