Downloads · 30 days
301
6% of all-time downloads
Niansuh/t5-v1_1-xxl-encoder-gguf
t5-v1_1-xxl-encoder-gguf is a machine learning model from Niansuh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
Downloads · 30 days
301
6% of all-time downloads
All-time downloads
4.9K
Public
Repo size
56.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf56.7 GB · 100%
From the Hugging Face model README
This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
The weights can be used with ./llama-embedding or with the ComfyUI-GGUF custom node together with image generation models.
This is a non imatrix quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use Q5_K_M or larger for the best results, although smaller models may also still provide decent results in resource constrained scenarios.