cloudyu_-_Mixtral_13B_Chat-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Mixtral_13B_Chat - GGUF

• Model creator: https://huggingface.co/cloudyu/
• Original model: https://huggingface.co/cloudyu/Mixtral_13B_Chat/

Original model description:

license: mit

This is a fine-tuned 13B chat model

code example

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
import math

## v2 models
model_path = "cloudyu/Mixtral_13B_Chat"

tokenizer = AutoTokenizer.from_pretrained(model_path, use_default_system_prompt=False)
model = AutoModelForCausalLM.from_pretrained(
        model_path, torch_dtype=torch.bfloat16, device_map='auto',local_files_only=False, load_in_4bit=True
)
print(model)
prompt = input("please input prompt:")
while len(prompt) > 0:
  input_ids = tokenizer(prompt, return_tensors="pt").input_ids.to("cuda")

  generation_output = model.generate(
    input_ids=input_ids, max_new_tokens=800,repetition_penalty=1.2
  )
  print(tokenizer.decode(generation_output[0]))
  prompt = input("please input prompt:")

output examples

<s> 12+13-24=?
To solve this equation, we need to follow the order of operations (PEMDAS/BODMAS): Parentheses, Exponents, Multiplication and Division (from left to right), Addition and Subtraction (from left to right).

Given expression: 12 + 13 - 24
First, let's add 12 and 13 together:
12 + 13 = 25
Now our expression looks like this: 25 - 24
Next, subtract 24 from 25:
25 - 24 = 1
So, the final answer is 1.</s>

<s> write a story about yosemite national park in 1000 words.The sun had just begun to rise over the horizon, casting its golden light upon Yosemite National Park's majestic granite cliffs and towering sequoias. As the first rays of sunlight touched the earth, they illuminated the misty waterfalls that cascaded down from high above, creating an ethereal scene straight out of a fairytale.

In this enchanting land, where nature reigned supreme, there lived a young girl named Ava who had come here seeking solace after losing her parents in a tragic accident. She found herself drawn to the beauty and serenity of Yosemite, which seemed to offer a sense of peace she couldn’t find anywhere else.

Ava spent most days exploring the vast expanse of the park, hiking through meadows filled with wildflowers or scaling rock formations that offered breathtaking views of the valley below. At night, she would sit by the campfire, gazing up at the star-studded sky while listening to the soothing sounds of the river flowing nearby. It was during these moments that she felt closest to her parents, as if their spirits were guiding her on this journey towards healing.

One day, while wandering along one of the many trails leading into the heart of the park, Ava stumbled upon something unexpected – a small wooden box nestled among the roots of an ancient tree. Curious, she picked it up and opened it to discover a handwritten letter inside. The paper was yellowed with age but still legible, bearing the name "John Muir" at the top.

As she read aloud his words, Ava learned that John Muir had been instrumental in preserving Yosemite National Park back when it was threatened by development projects. He believed deeply in protecting our natural resources for future generations, and he poured his passion into writing letters to politicians and influential figures, urging them to take action. His efforts eventually paid off, resulting in the establishment of what is now known as America's first national park.

Feeling inspired by John Muir's dedication to conservation, Ava decided to follow in his footsteps by penning her own plea for environmental protection. With renewed purpose, she returned home and began researching ways to make a difference. After months of hard work, she drafted a proposal detailing various initiatives aimed at reducing carbon emissions, promoting sustainable practices, and raising awareness about climate change.

Her plan caught the attention of several prominent environmental organizations, who agreed to support her cause wholeheartedly. Together, they launched a campaign called "Save Our Earth: One Step at a Time," encouraging people worldwide to adopt eco-friendly habits such as recycling, using public transportation whenever possible, and planting trees.

Over time, the movement gained momentum, attracting supporters from all walks of life. Celebrities lent their voices to raise awareness, businesses pledged to reduce their carbon footprint, and governments around the globe started implementing policies designed to protect the environment. Slowly but surely, progress was being made.

Years passed since Ava's discovery in Yosemite National Park, yet the memory of finding John Muir's letter remained etched in her mind like a cherished treasure. Now married with two children of her own, she continued advocating for environmental justice alongside her husband, who shared her passion for preservation. Their family often visited Yosemite together, passing on stories about John Muir and his legacy to their kids.

On one particular trip, while hiking through a dense forest, Ava noticed something peculiar – a group of loggers cutting down trees without any regard for the surrounding ecosystem. Angered by this blatant disregard for nature, she approached the men and demanded an explanation. They replied dismissively, claiming they needed the wood for construction purposes.

Refusing to accept defeat, Ava took matters into her own hands. She gathered her family and friends, forming a human chain around the area designated for logging. Determined not to let anyone harm the precious forest, they stood firm against the loggers until authorities arrived on site. Eventually, the situation escalated into a standoff between both parties, drawing media attention from across the country.

During this tense standoff, Ava recounted her experience with John Muir's letter and how it led her to create the "Save Our Earth" initiative. Her words resonated strongly with those present, sparking conversations about sustainability and responsible resource management. Ultimately, the loggers relented under public pressure, agreeing to cease operations within the protected area.

This incident marked a turning point in Ava's crusade for environmental protection. From then onwards, she dedicated herself fully to spreading awareness about the importance of conserving our planet's natural wonders. Through her tireless efforts, more people became aware of the need for sustainable living practices, ultimately contributing to positive changes in government policies and corporate behavior.

Today, Yosemite National Park remains a testament to the power of individual actions combined with collective effort. Its pristine landscapes continue inspiring countless visitors each year, reminding us all that we have a responsibility towards safeguarding our planet for future generations. And amidst these stunning vistas stands Ava, proudly carrying forth John Muir's legacy, ensuring that his dream of preserving nature lives on forever.</s>