Downloads · 30 days
48
2% of all-time downloads
QuantFactory/Replete-LLM-gemma-9b-test-merged-250k-GGUF
Replete-LLM-gemma-9b-test-merged-250k-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
48
2% of all-time downloads
All-time downloads
2.6K
Public
Repo size
84.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf84.7 GB · 100%
From the Hugging Face model README
This is quantized version of Replete-AI/Replete-LLM-gemma-9b-test-merged-250k created using llama.cpp
Test on the (Replete-AI/Everything_Instruct_Mini_Multilingual) dataset
Prompt template:
<start_of_turn>system
{}<end_of_turn>
<start_of_turn>user
{}<end_of_turn>
<start_of_turn>model
{}