Downloads · 30 days
102
15% of all-time downloads
musk12/apple-fastvlm-qwen2-q4-gguf
apple-fastvlm-qwen2-q4-gguf is a text generation model from musk12. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
A Qwen2 GGUF model quantized in Q4KM format for CPU memory-efficient inference. This FastVLM LLM backbone is optimized for low-memory and low-latency CPU deployment.
Downloads · 30 days
102
15% of all-time downloads
All-time downloads
660
Public
Repo size
491 MB
Likes
0
Public
Click a slice to open those files.
.gguf491 MB · 100%
From the Hugging Face model README
A Qwen2 GGUF model quantized in Q4_K_M format for CPU memory-efficient inference. This FastVLM LLM backbone is optimized for low-memory and low-latency CPU deployment.
fastvlm_qwen2_q4km.ggufUse this model with llama.cpp-compatible runtimes for fast CPU-based language generation in FastVLM.
./llama-cli -m fastvlm_qwen2_q4km.gguf -p "Your prompt here"
Derived from: