Downloads · 30 days
8
50% of all-time downloads
viperprojects47/viper-ai
viper-ai is a text generation model from viperprojects47. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Viper is a custom language model based on Qwen2.5-7B-Instruct, fine-tuned by viperprojects47 for custom software development assistance. It is distributed as a 4-bit quantized GGUF for use with llama.cpp, Ollama, and…
Downloads · 30 days
8
50% of all-time downloads
All-time downloads
16
Public
Repo size
4.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf4.7 GB · 100%
From the Hugging Face model README
Viper is a custom language model based on Qwen2.5-7B-Instruct, fine-tuned by viperprojects47 for custom software development assistance. It is distributed as a 4-bit quantized GGUF for use with llama.cpp, Ollama, and any OpenAI-compatible server.
| File | Size | Quant | Description |
|---|---|---|---|
viper.gguf | 4.4GB | Q4_K_M | Quantized GGUF for llama.cpp etc. |
llama-server -m viper.gguf --port 8080 -c 2048 -ngl 99
Then call the OpenAI-compatible endpoint:
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"messages": [{"role": "user", "content": "Who developed you?"}]}'
ollama run hf.co/USERNAME/viper-ai
or create a local model:
ollama create viper -f ./Modelfile
Q4_K_Mviperprojects47