Downloads · 30 days
0
QuantumCuddle/DistillAgent-PaperQA-3B-GGUF
DistillAgent-PaperQA-3B-GGUF is a text generation model from QuantumCuddle. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF exports for QuantumCuddle/DistillAgent-PaperQA-3B.
Downloads · 30 days
0
Access
Public
Updated May 10, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 70%
From the Hugging Face model README
GGUF exports for QuantumCuddle/DistillAgent-PaperQA-3B.
Main HF model repo:
Files:
...-F16.gguf (high quality, larger)...-Q4_K_M.gguf (smaller/faster, if uploaded)Example (llama.cpp):
llama-cli -m qwen-qwen25-3b-instruct-qasper-qasper_qwen25_3b_sft_v2_fixed-F16.gguf -p "QUESTION: ..."
For metrics, training details, and limitations, see the main model card.