Downloads · 30 days
17
11% of all-time downloads
UnluckyOrangutan/thomas-zhu-lean-premise-gguf
thomas-zhu-lean-premise-gguf is a sentence similarity model from UnluckyOrangutan. Use it when you need a score for how close two texts are. It is set up for gguf. The card lists the license as apache-2.0.
GGUF conversion of the Lean premise embedding model used by hanwenzhu/lean-premise-server.
Downloads · 30 days
17
11% of all-time downloads
All-time downloads
161
Public
Repo size
166 MB
Likes
0
Public
Click a slice to open those files.
.gguf166 MB · 100%
From the Hugging Face model README
GGUF conversion of the Lean premise embedding model used by hanwenzhu/lean-premise-server.
l3lab/all-distilroberta-v1-lr2e-4-bs256-nneg3-ml-ne2v4.30.0RobertaModelthomas-zhu-lean-premise.f16.ggufExample with joint-server in non-joint premise mode:
server/build/joint-server.exe --host 127.0.0.1 --port 8081 --model D:/hparam_outputs/thomas-zhu-lean-premise.f16.gguf --no-joint --pooling mean --ctx-size 512
Use /version, /cache, and /select for premise retrieval. Autoregressive chat generation is intentionally rejected in --no-joint mode.