Downloads · 30 days
36
5% of all-time downloads
Tivaphraen/Ornith-Agents-A1-GGUF
Ornith-Agents-A1-GGUF is a text generation model from Tivaphraen. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
36
5% of all-time downloads
All-time downloads
763
Public
Repo size
62.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf62.7 GB · 100%
From the Hugging Face model README

GGUF conversion of tepirale/Ornith-Agents-A1-3.6-35B-A3B-dare_ties for local inference with llama.cpp-compatible runtimes.
This model is based on:
Upstream merge sources:
Upstream merge method:
DARE-TIESThis repository provides GGUF files for practical local use.
Model files are named like:
Ornith-Agents-A1-Q3_K_M.ggufOrnith-Agents-A1-Q4_K_M.ggufOrnith-Agents-A1-Q5_K_M.ggufIf you just want to test the model, start with:
Ornith-Agents-A1-Q4_K_M.gguf./llama-cli \
-m Ornith-Agents-A1-Q4_K_M.gguf \
--jinja \
-c 8192 \
--temp 0.6 \
--top-p 0.95 \
--top-k 20 \
--min-p 0.0
./llama-server \
-m Ornith-Agents-A1-Q4_K_M.gguf \
--jinja \
-c 8192 \
--host 127.0.0.1 \
--port 8080
llama.cppThis is a community GGUF conversion of an experimental merge. Please evaluate it yourself for quality, stability, and suitability for your use case.