Downloads · 30 days
20
2% of all-time downloads
RichardErkhov/cutycat2000_-_MeowGPT-2-gguf
cutycat2000_-_MeowGPT-2-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
20
2% of all-time downloads
All-time downloads
846
Public
Repo size
34.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf40.2 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
MeowGPT-2 - GGUF
| Name | Quant method | Size |
|---|---|---|
| MeowGPT-2.Q2_K.gguf | Q2_K | 1.09GB |
| MeowGPT-2.IQ3_XS.gguf | IQ3_XS | 1.21GB |
| MeowGPT-2.IQ3_S.gguf | IQ3_S | 1.27GB |
| MeowGPT-2.Q3_K_S.gguf | Q3_K_S | 1.27GB |
| MeowGPT-2.IQ3_M.gguf | IQ3_M | 1.33GB |
| MeowGPT-2.Q3_K.gguf | Q3_K | 1.4GB |
| MeowGPT-2.Q3_K_M.gguf | Q3_K_M | 1.4GB |
| MeowGPT-2.Q3_K_L.gguf | Q3_K_L | 1.52GB |
| MeowGPT-2.IQ4_XS.gguf | IQ4_XS | 1.55GB |
| MeowGPT-2.Q4_0.gguf | Q4_0 | 1.62GB |
| MeowGPT-2.IQ4_NL.gguf | IQ4_NL | 1.63GB |
| MeowGPT-2.Q4_K_S.gguf | Q4_K_S | 1.63GB |
| MeowGPT-2.Q4_K.gguf | Q4_K | 1.72GB |
| MeowGPT-2.Q4_K_M.gguf | Q4_K_M | 1.72GB |
| MeowGPT-2.Q4_1.gguf | Q4_1 | 1.79GB |
| MeowGPT-2.Q5_0.gguf | Q5_0 | 1.95GB |
| MeowGPT-2.Q5_K_S.gguf | Q5_K_S | 1.95GB |
| MeowGPT-2.Q5_K.gguf | Q5_K | 2.01GB |
| MeowGPT-2.Q5_K_M.gguf | Q5_K_M | 2.01GB |
| MeowGPT-2.Q5_1.gguf | Q5_1 | 2.12GB |
| MeowGPT-2.Q6_K.gguf | Q6_K | 2.31GB |
| MeowGPT-2.Q8_0.gguf | Q8_0 | 2.99GB |
license: mit language:
MeowGPT, developed by CutyCat2000, is a language model based on Llama with the checkpoint version 3. Trained on the OpenOrca dataset, this model is designed to generate text in a conversational manner and can be used for various natural language processing tasks.
To use MeowGPT, you can load it via the transformers library in Python using the following code:
from transformers import LlamaTokenizer, AutoModelForCausalLM, AutoTokenizer
tokenizer = LlamaTokenizer.from_pretrained("cutycat2000/MeowGPT-2")
model = AutoModelForCausalLM.from_pretrained("cutycat2000/MeowGPT-2")
An example of how to prompt the model for generating text:
prompt = "<s> [|User|] Hello World </s>[|Assistant|]"
The <s> and </s> are start and end tokens.
If you use MeowGPT in your research or projects, please consider citing CutyCat2000 and the relevant resources associated with the OpenOrca dataset.
Please note that while MeowGPT is trained to assist in generating text based on given prompts, it may not always provide accurate or contextually appropriate responses. It's recommended to review and validate the generated content before usage in critical applications.
For more information or support, refer to the transformers library documentation or CutyCat2000's resources.