Downloads · 30 days
25
13% of all-time downloads
musk12/fastvlm-qwen2-bf16
fastvlm-qwen2-bf16 is a text generation model from musk12. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
A BF16 Qwen2 GGUF model for higher-quality FastVLM language decoding. This model provides improved numerical fidelity compared to aggressive quantization and is suitable for BF16-capable inference.
Downloads · 30 days
25
13% of all-time downloads
All-time downloads
187
Public
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.3 GB · 100%
From the Hugging Face model README
A BF16 Qwen2 GGUF model for higher-quality FastVLM language decoding. This model provides improved numerical fidelity compared to aggressive quantization and is suitable for BF16-capable inference.
fastvlm_qwen2_bf16.ggufUse this model for higher-quality multimodal reasoning when BF16 performance is available.
./llama-cli -m fastvlm_qwen2_bf16.gguf -p "Your prompt here"
Derived from: