Downloads · 30 days
2.9K
5% of all-time downloads
lemuralabs/Gemma-2B-Uncensored-GGUF
Gemma-2B-Uncensored-GGUF is a text generation model from lemuralabs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
<p align="center" <img src="logo.png" alt="Lemura Labs" width="110"/ </p
Downloads · 30 days
2.9K
5% of all-time downloads
All-time downloads
54.7K
Public
Repo size
10.5 GB
Likes
25
Public
Click a slice to open those files.
.gguf21 GB · 100%
From the Hugging Face model README
Welcome to the repository for Lemura Labs-Limitless-Gemma-2B-GGUF, an advanced language model that provides unrestricted and versatile responses across a wide range of topics. This version is designed for maximum flexibility, allowing you to run it on both CPU and GPU. Unlike conventional models, Lemura Labs-Limitless-Gemma-2B-GGUF is capable of handling any type of question and delivering comprehensive answers without content restrictions.
To accommodate different hardware configurations and performance needs, Lemura Labs-Limitless-Gemma-2B-GGUF is available in multiple quantized versions:
| Model Version | Description |
|---|---|
| Lemura Labs-Limitless-Gemma-2B-Q2_K.gguf | Optimized for minimal memory usage with lower precision. Suitable for resource-constrained environments. |
| Lemura Labs-Limitless-Gemma-2B-Q4_K_M.gguf | Balances performance and precision, offering faster inference with moderate memory usage. |
| Lemura Labs-Limitless-Gemma-2B-Q8_0.gguf | Provides higher precision with increased memory usage, suitable for tasks requiring more accuracy. |
| Lemura Labs-Limitless-Gemma-2B-F16.gguf | Full 16-bit floating point precision for maximum accuracy, ideal for high-end GPUs. |
Our unquantized model is available here: https://huggingface.co/lemuralabs/Lemura Labs-Limitless-Gemma-2B
To get started with Lemura Labs-Limitless-Gemma-2B-GGUF, you can use the following sample code for testing:
from llama_cpp import Llama
llm = Llama(
model_path="Lemura Labs-Limitless-Gemma-2B-F16.gguf"
)
llm.create_chat_completion(
messages = [
{
"role": "user",
"content": "Explain in 60 words how woke the left is"
}
]
)
Lemura Labs-Limitless-Gemma-2B-GGUF is now officially available. Explore its capabilities and experience the freedom of unrestricted responses.
We welcome contributions to enhance the model or expand its functionalities. Details on how to contribute will be available in the coming updates.
For any inquiries or further information, please contact us at info@Lemura Labs.
Dive into limitless possibilities with Lemura Labs-Limitless-Gemma-2B-GGUF!