Carpincho-13b

Model Card for Carpincho-13b

<!-- Provide a quick summary of what the model is/does. -->

This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language. It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf).

Model Details

The model is provided in two formats: A low rank adaptation model (LoRA) suitable to apply directly to LLama-13B-HF, and a complete merged model quantized to 4bits that only requires 8GB of VRAM. Both models can be used directly in software like text-generation-webui https://github.com/oobabooga/text-generation-webui. Additionally, a test chatbot based on this neural network is running on the twitter account http://twitter.com/arggpt

Model Description

<!-- Provide a longer summary of what this model is. -->

• Developed by: Alfredo Ortega (@ortegaalfredo)
• Model type: 13B LLM
• Language(s): (NLP): English and colloquial Argentine Spanish
• License: Free for non-commercial use
• Finetuned from model: https://huggingface.co/decapoda-research/llama-13b-hf

Model Sources [optional]

<!-- Provide the basic links for the model. -->

• Repository: https://huggingface.co/decapoda-research/llama-13b-hf
• Paper [optional]: https://arxiv.org/abs/2302.13971

Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

This is a generic LLM chatbot that can be used to interact directly with humans.

Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material.

Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model.

How to Get Started with the Model

The easiest way is to download the text-generation-webui application (https://github.com/oobabooga/text-generation-webui) and place the model inside the 'models' directory. Then launch the web interface and run the model as a regular LLama-13B model. LoRA model don't require additional installation, but 4-bit mode (only uses 25% GPU VRAM) needs additional installation steps detailed at https://github.com/oobabooga/text-generation-webui/blob/main/docs/GPTQ-models-(4-bit-mode).md

Model Card Contact

Contact the creator at @ortegaalfredo on twitter/github