mncai_-_mistral-7b-v5-4bits

Quantization made by Richard Erkhov.

Github

Discord

Request more models

mistral-7b-v5 - bnb 4bits

• Model creator: https://huggingface.co/mncai/
• Original model: https://huggingface.co/mncai/mistral-7b-v5/

Original model description:

license: llama2 language:

• en

---

Model Card for mncai/mistral-7b-v5

Introduction of MindsAndCompany

https://mnc.ai/

We create various AI models and develop solutions that can be applied to businesses. And as for generative AI, we are developing products like Code Assistant, TOD Chatbot, LLMOps, and are in the process of developing Enterprise AGI (Artificial General Intelligence).

Model Summary

based mistral-7b, instruction tuned and dpo.

How to Use

Here give some examples of how to use our model.

from transformers import AutoConfig, AutoModel, AutoTokenizer
import transformers
import torch
hf_model = 'mncai/mistral-7b-v5' 
message =  "### Instruction:\n\n두 개의 구가 각각 지름이 1, 2일때 두 구의 부피는 몇배지? 설명도 같이 해줘.\n\n### Response:\n"

sequences = pipeline(
    message,
    do_sample=True,
    top_k=10,
    num_return_sequences=1,
    eos_token_id=tokenizer.eos_token_id,
    max_length=2048,
)
for seq in sequences:
    print(f"Result: {seq['generated_text']}")

Contact

If you have any questions, please raise an issue or contact us at [email protected]