Downloads · 30 days
53
5% of all-time downloads
rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct-q8-gguf
Llama-3-portuguese-Tom-cat-8b-instruct-q8-gguf is a text generation model from rhaymison. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<p align="center" <img src="https://raw.githubusercontent.com/rhaymisonbetini/huggphotos/main/tom-cat-8b.webp" width="50%" style="margin-left:'auto' margin-right:'auto' display:'block'"/ </p
Downloads · 30 days
53
5% of all-time downloads
All-time downloads
1.1K
Public
Repo size
8.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf8.5 GB · 100%
From the Hugging Face model README
This model was trained with a superset of 300,000 chat in Portuguese. The model comes to help fill the gap in models in Portuguese. Tuned from the Tom cat 8b instruct , the model was adjusted mainly for chat.
!git lfs install
!pip install langchain
!pip install langchain-community langchain-core
!pip install llama-cpp-python
!git clone https://huggingface.co/rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct-q8-gguf/
def llamacpp():
from langchain.llms import LlamaCpp
from langchain.prompts import PromptTemplate
from langchain.chains import LLMChain
llm = LlamaCpp(
model_path="/content/Llama-3-portuguese-Tom-cat-8b-instruct-q8-gguf",
n_gpu_layers=40,
n_batch=512,
verbose=True,
)
template = f"""<|begin_of_text|><|start_header_id|>system<|end_header_id|>
Abaixo está uma instrução que descreve uma tarefa, juntamente com uma entrada que fornece mais contexto. Escreva uma resposta que complete adequadamente o pedido.<|eot_id|><|start_header_id|>user<|end_header_id|>
{ question }<|eot_id|><|start_header_id|>assistant<|end_header_id|>"""
prompt = PromptTemplate(template=template, input_variables=["question"])
llm_chain = LLMChain(prompt=prompt, llm=llm)
question = "instrução: aja como um professor de matemática e me explique porque 2 + 2 = 4?"
response = llm_chain.run({"question": question})
print(response)
Any idea, help or report will always be welcome.
email: [email protected]
<div style="display:flex; flex-direction:row; justify-content:left"> <a href="https://www.linkedin.com/in/rhaymison-cristian-betini-2b3016175/" target="_blank"> <img src="https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white"> </a> <a href="https://github.com/rhaymisonbetini" target="_blank"> <img src="https://img.shields.io/badge/GitHub-100000?style=for-the-badge&logo=github&logoColor=white"> </a> </div>