Downloads · 30 days
325
11% of all-time downloads
T.E-8.1-GGUF-IQ-Imatrix-Request
Lewdiculous/T.E-8.1-GGUF-IQ-Imatrix-Request
T.E-8.1-GGUF-IQ-Imatrix-Request is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
2.9K
Public
Repo size
75.6 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf75.6 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Sep 29, 2024
- Updated
- Sep 29, 2024
- SHA
- 3e758fb0
Base models
Model card
From the Hugging Face model README
Model name: <br> T.E-8.1
Brief description: <br> Qwen2.5-7B based model trained for roleplay uses.
[!TIP] Presets: <br> You can use the built in ChatML presets within SillyTavern and adjust from there. <br> Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.
[!NOTE] Request page: <br> https://huggingface.co/Lewdiculous/Model-Requests/discussions/76
Model link: <br> https://huggingface.co/Cran-May/T.E-8.1
Quantized with llama.cpp: <br> b3837
1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16) 2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)
- License
- cc-by-nc-4.0
- Created
- Sep 29, 2024
- Updated
- Sep 29, 2024