Downloads · 30 days
102
26% of all-time downloads
chartreuse-verte/distilbert-base-uncased-go-emotions-student-GGUF
distilbert-base-uncased-go-emotions-student-GGUF is a text classification model from chartreuse-verte. Use it when you need a label for a piece of text. The card lists the license as mit.
GGUF conversion of joeddav/distilbert-base-uncased-go-emotions-student, a DistilBERT model distilled from a zero-shot classification pipeline into the 28 GoEmotions labels, for use with llama.cpp.
Downloads · 30 days
102
26% of all-time downloads
All-time downloads
391
Public
Repo size
313 MB
Likes
0
Public
Click a slice to open those files.
.gguf313 MB · 100%
From the Hugging Face model README
GGUF conversion of joeddav/distilbert-base-uncased-go-emotions-student, a DistilBERT model distilled from a zero-shot classification pipeline into the 28 GoEmotions labels, for use with llama.cpp.
| File | Quant | Size |
|---|---|---|
| goemotions-f16.gguf | F16 | 129 MiB |
| goemotions-Q8_0.gguf | Q8_0 | 70 MiB |
| goemotions-Q6_K.gguf | Q6_K | 54 MiB |
| goemotions-Q4_K_M.gguf | Q4_K_M | 45 MiB |
Run with llama-embedding using rank pooling to get the 28 classifier logits:
llama-embedding -m goemotions-Q8_0.gguf --pooling rank --embd-normalize -1 -p "your text here"
Note: --embd-normalize defaults to 2 (L2 normalization), which is meaningless for classifier logits — always pass --embd-normalize -1 to get raw scores.