Downloads · 30 days
45
17% of all-time downloads
Novaciano/Prototype-Virus-1B-GGUF
Prototype-Virus-1B-GGUF is a question answering model from Novaciano. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as gemma.
Model creator: UmbrellaInc<br/ Original model: UmbrellaInc/Prototype-Virus-1B<br/ GGUF quantization: provided by Novaciano using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working on llama.c…
Downloads · 30 days
45
17% of all-time downloads
All-time downloads
272
Public
Repo size
806 MB
Likes
0
Public
Click a slice to open those files.
.gguf806 MB · 100%
From the Hugging Face model README
Model creator: UmbrellaInc<br/>
Original model: UmbrellaInc/Prototype-Virus-1B<br/>
GGUF quantization: provided by Novaciano using llama.cpp<br/>
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
ollama run "hf.co/Novaciano/Prototype-Virus-1B-GGUF:Q4_K_M"
lms load "Novaciano/Prototype-Virus-1B-GGUF"
llama-cli --hf "Novaciano/Prototype-Virus-1B-GGUF:Q4_K_M" -p "The meaning to life and the universe is"
llama-server --hf "Novaciano/Prototype-Virus-1B-GGUF:Q4_K_M" -c 4096