Downloads · 30 days
8
20% of all-time downloads
miqu-1-70b-sf-exl2-2-4.65b
matatonic/miqu-1-70b-sf-exl2-2-4.65b
miqu-1-70b-sf-exl2-2-4.65b is a text generation model from matatonic. Use it when you need the model to write or continue text. It is set up for transformers.
from: [https://huggingface.co/miqudev/miqu-1-70b] to: [https://huggingface.co/152334H/miqu-1-70b-sf] quantized as: 4.65bpw exl2 with exllamav2 v0.0.13 chat template with system prompt support included. Works with 48GB…
All-time downloads
40
Public
Repo size
40.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors40.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024
- SHA
- 36d62b17
Try a prompt
Model card
From the Hugging Face model README
- from: [https://huggingface.co/miqudev/miqu-1-70b]
- to: [https://huggingface.co/152334H/miqu-1-70b-sf]
- quantized as: 4.65bpw exl2 with exllamav2 v0.0.13
- chat template with system prompt support included.
- Works with 48GB and FP8 cache @ 32k context in TabbyAPI
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Mar 5, 2024
- Updated
- Mar 5, 2024