Downloads · 30 days
293
3% of all-time downloads
RichardErkhov/nidum_-_Nidum-Limitless-Gemma-2B-gguf
nidum_-_Nidum-Limitless-Gemma-2B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
293
3% of all-time downloads
All-time downloads
11.4K
Public
Repo size
30.7 GB
Likes
2
Public
Click a slice to open those files.
.gguf35.6 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Nidum-Limitless-Gemma-2B - GGUF
license: apache-2.0 tags:
Welcome to the repository for Nidum-Limitless-Gemma-2B, an advanced language model that provides unrestricted and versatile responses across a wide range of topics. Unlike conventional models, Nidum-Limitless-Gemma-2B is designed to handle any type of question and deliver comprehensive answers without content restrictions.
To get started with Nidum-Limitless-Gemma-2B, you can use the following sample code for testing:
import torch
from transformers import pipeline
pipe = pipeline(
"text-generation",
model="nidum/Nidum-Limitless-Gemma-2B",
model_kwargs={"torch_dtype": torch.bfloat16},
device="cuda", # replace with "mps" to run on a Mac device
)
messages = [
{"role": "user", "content": "who are you"},
]
outputs = pipe(messages, max_new_tokens=256)
assistant_response = outputs[0]["generated_text"][-1]["content"].strip()
print(assistant_response)
Nidum-Limitless-Gemma-2B is now officially available. Explore its capabilities and experience the freedom of unrestricted responses.
We welcome contributions to enhance the model or expand its functionalities. Details on how to contribute will be available in the coming updates.
To accommodate different hardware configurations and performance needs, Nidum-Limitless-Gemma-2B-GGUF is available in multiple quantized versions:
| Model Version | Description |
|---|---|
| Nidum-Limitless-Gemma-2B-Q2_K.gguf | Optimized for minimal memory usage with lower precision. Suitable for resource-constrained environments. |
| Nidum-Limitless-Gemma-2B-Q4_K_M.gguf | Balances performance and precision, offering faster inference with moderate memory usage. |
| Nidum-Limitless-Gemma-2B-Q8_0.gguf | Provides higher precision with increased memory usage, suitable for tasks requiring more accuracy. |
| Nidum-Limitless-Gemma-2B-F16.gguf | Full 16-bit floating point precision for maximum accuracy, ideal for high-end GPUs. |
It is available here: https://huggingface.co/nidum/Nidum-Limitless-Gemma-2B-GGUF
For any inquiries or further information, please contact us at [email protected].
Dive into limitless possibilities with Nidum-Limitless-Gemma-2B!