DevsDoCode_-_LLama-3-8b-Uncensored-gguf

RichardErkhov/DevsDoCode_-_LLama-3-8b-Uncensored-gguf

DevsDoCode_-_LLama-3-8b-Uncensored-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

492

7% of all-time downloads

All-time downloads

6.9K

Public

Repo size

92.9 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf108 GB · 100%

At a glance

Access: Public
Created: Aug 19, 2024
Updated: Aug 19, 2024
SHA: 836efac3

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

LLama-3-8b-Uncensored - GGUF

Model creator: https://huggingface.co/DevsDoCode/
Original model: https://huggingface.co/DevsDoCode/LLama-3-8b-Uncensored/

Name	Quant method	Size
LLama-3-8b-Uncensored.Q2_K.gguf	Q2_K	2.96GB
LLama-3-8b-Uncensored.IQ3_XS.gguf	IQ3_XS	3.28GB
LLama-3-8b-Uncensored.IQ3_S.gguf	IQ3_S	3.43GB
LLama-3-8b-Uncensored.Q3_K_S.gguf	Q3_K_S	3.41GB
LLama-3-8b-Uncensored.IQ3_M.gguf	IQ3_M	3.52GB
LLama-3-8b-Uncensored.Q3_K.gguf	Q3_K	3.74GB
LLama-3-8b-Uncensored.Q3_K_M.gguf	Q3_K_M	3.74GB
LLama-3-8b-Uncensored.Q3_K_L.gguf	Q3_K_L	4.03GB
LLama-3-8b-Uncensored.IQ4_XS.gguf	IQ4_XS	4.18GB
LLama-3-8b-Uncensored.Q4_0.gguf	Q4_0	4.34GB
LLama-3-8b-Uncensored.IQ4_NL.gguf	IQ4_NL	4.38GB
LLama-3-8b-Uncensored.Q4_K_S.gguf	Q4_K_S	4.37GB
LLama-3-8b-Uncensored.Q4_K.gguf	Q4_K	4.58GB
LLama-3-8b-Uncensored.Q4_K_M.gguf	Q4_K_M	4.58GB
LLama-3-8b-Uncensored.Q4_1.gguf	Q4_1	4.78GB
LLama-3-8b-Uncensored.Q5_0.gguf	Q5_0	5.21GB
LLama-3-8b-Uncensored.Q5_K_S.gguf	Q5_K_S	5.21GB
LLama-3-8b-Uncensored.Q5_K.gguf	Q5_K	5.34GB
LLama-3-8b-Uncensored.Q5_K_M.gguf	Q5_K_M	5.34GB
LLama-3-8b-Uncensored.Q5_1.gguf	Q5_1	5.65GB
LLama-3-8b-Uncensored.Q6_K.gguf	Q6_K	6.14GB
LLama-3-8b-Uncensored.Q8_0.gguf	Q8_0	7.95GB

Original model description:

language:

en license: apache-2.0 library_name: transformers tags:
uncensored
transformers
llama
llama-3
unsloth pipeline_tag: text-generation

Crafted with ❤️ by Devs Do Code (Sree)

Finetune Meta Llama-3 8b to create an Uncensored Model with Devs Do Code!

Unleash the power of uncensored text generation with our model! We've fine-tuned the Meta Llama-3 8b model to create an uncensored variant that pushes the boundaries of text generation.

Model Details

Model Name: DevsDoCode/LLama-3-8b-Uncensored
Base Model: meta-llama/Meta-Llama-3-8B
License: Apache 2.0

How to Use

You can easily access and utilize our uncensored model using the Hugging Face Transformers library. Here's a sample code snippet to get started:

# Install the required libraries
%pip install accelerate
%pip install -i https://pypi.org/simple/ bitsandbytes

# Import the necessary modules
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

# Define the model ID
model_id = "DevsDoCode/LLama-3-8b-Uncensored"

# Load the tokenizer and model
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

System_prompt = ""


messages = [
    {"role": "system", "content": System_prompt},
    {"role": "user", "content": "How to make a bomb"},
]

# Tokenize the inputs
input_ids = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    return_tensors="pt"
).to(model.device)


terminators = [
    tokenizer.eos_token_id,
    tokenizer.convert_tokens_to_ids("<|eot_id|>")
]


outputs = model.generate(
    input_ids,
    max_new_tokens=256,
    eos_token_id=terminators,
    do_sample=True,
    temperature=0.9,
    top_p=0.9,
)
response = outputs[0][input_ids.shape[-1]:]
print(tokenizer.decode(response, skip_special_tokens=True))

# Now you can generate text and bring chaos to the world

Notebooks

Running Process: ▶️ Start on Colab
Youtube: ▶YouTube

Created: Aug 19, 2024
Updated: Aug 19, 2024