Downloads · 30 days
75
25% of all-time downloads
augmem/teg-421m-gguf
teg-421m-gguf is a feature extraction model from augmem. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF-quantized versions of TEG-421M for edge deployment.
Downloads · 30 days
75
25% of all-time downloads
All-time downloads
295
Public
Repo size
1.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.4 GB · 100%
From the Hugging Face model README
GGUF-quantized versions of TEG-421M for edge deployment.
TEG (Trimodal Embeddings Gemma) maps image, audio, and text into a shared 768-dim embedding space via Google's embeddinggemma-300M, with Matryoshka truncation support down to 128 dims.
| File | Quant | Size | Description |
|---|---|---|---|
teg-421m-q8_0.gguf | Q8_0 | 501 MB | 8-bit — minimal quality loss |
teg-421m-q5_0.gguf | Q5_0 | 408 MB | 5-bit — good balance of size and quality |
teg-421m-q4_1.gguf | Q4_1 | 390 MB | 4-bit with offsets — best for constrained devices |
All variants use per-component quantization: Gemma text model gets the target quant, image/audio encoders stay at Q8_0, and projection heads stay at F16 to preserve retrieval quality.
See the full model card for complete architecture details, benchmarks, and training information.
Text --> embeddinggemma-300M --------------------------> 768-dim
Image --> MobileNetV4-Medium (1280-d) --> DeepProjection -> 768-dim
Audio --> EfficientAT mn20_as (1920-d) --> DeepProjection -> 768-dim
Total parameters (fp32): 420.6M
These quantizations were produced from augmem/teg-421m.
Apache 2.0