Downloads · 30 days
51
9% of all-time downloads
desertrat86/Nidum-Gemma-2B-Uncensored-GGUF
Nidum-Gemma-2B-Uncensored-GGUF is a text generation model from desertrat86. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
51
9% of all-time downloads
All-time downloads
542
Public
Repo size
10.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf10.5 GB · 100%
From the Hugging Face model README
Welcome to the repository for Nidum-Limitless-Gemma-2B-GGUF, an advanced language model that provides unrestricted and versatile responses across a wide range of topics. This version is designed for maximum flexibility, allowing you to run it on both CPU and GPU. Unlike conventional models, Nidum-Limitless-Gemma-2B-GGUF is capable of handling any type of question and delivering comprehensive answers without content restrictions.
To accommodate different hardware configurations and performance needs, Nidum-Limitless-Gemma-2B-GGUF is available in multiple quantized versions:
| Model Version | Description |
|---|---|
| Nidum-Limitless-Gemma-2B-Q2_K.gguf | Optimized for minimal memory usage with lower precision. Suitable for resource-constrained environments. |
| Nidum-Limitless-Gemma-2B-Q4_K_M.gguf | Balances performance and precision, offering faster inference with moderate memory usage. |
| Nidum-Limitless-Gemma-2B-Q8_0.gguf | Provides higher precision with increased memory usage, suitable for tasks requiring more accuracy. |
| Nidum-Limitless-Gemma-2B-F16.gguf | Full 16-bit floating point precision for maximum accuracy, ideal for high-end GPUs. |
Our unquantized model is available here: https://huggingface.co/nidum/Nidum-Limitless-Gemma-2B
To get started with Nidum-Limitless-Gemma-2B-GGUF, you can use the following sample code for testing:
from llama_cpp import Llama
llm = Llama(
model_path="Nidum-Limitless-Gemma-2B-F16.gguf"
)
llm.create_chat_completion(
messages = [
{
"role": "user",
"content": "Explain in 60 words how woke the left is"
}
]
)
Nidum-Limitless-Gemma-2B-GGUF is now officially available. Explore its capabilities and experience the freedom of unrestricted responses.
We welcome contributions to enhance the model or expand its functionalities. Details on how to contribute will be available in the coming updates.
For any inquiries or further information, please contact us at [email protected].
Dive into limitless possibilities with Nidum-Limitless-Gemma-2B-GGUF!