Downloads · 30 days
77
6% of all-time downloads
rhaymison/phi-3-portuguese-tom-cat-4k-instruct-q8-gguf
phi-3-portuguese-tom-cat-4k-instruct-q8-gguf is a text generation model from rhaymison. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<p align="center" <img src="https://raw.githubusercontent.com/rhaymisonbetini/huggphotos/main/tom-cat.webp" width="50%" style="margin-left:'auto' margin-right:'auto' display:'block'"/ </p
Downloads · 30 days
77
6% of all-time downloads
All-time downloads
1.3K
Public
Repo size
4.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.1 GB · 100%
From the Hugging Face model README
This GGUF model, derived from the Phi3 Tom cat 4k, has been quantized in q8. The model was trained with a superset of 300,000 instructions in Portuguese, aiming to help fill the gap in models available in Portuguese. Tuned from Phi3-4k, this model has been primarily adjusted for instructional tasks.
This model was trained with a superset of 300,000 instructions in Portuguese. The model comes to help fill the gap in models in Portuguese. Tuned from the microsoft/Phi-3-mini-4k.
Remember that verbs are important in your prompt. Tell your model how to act or behave so that you can guide them along the path of their response. Important points like these help models (even smaller models like 4b) to perform much better.
!git lfs install
!pip install langchain
!pip install langchain-community langchain-core
!pip install llama-cpp-python
!git clone https://huggingface.co/rhaymison/phi-3-portuguese-tom-cat-4k-instruct-q8-gguf
def llamacpp():
from langchain.llms import LlamaCpp
from langchain.prompts import PromptTemplate
from langchain.chains import LLMChain
llm = LlamaCpp(
model_path="/content/phi-3-portuguese-tom-cat-4k-instruct-q8-gguf",
n_gpu_layers=40,
n_batch=512,
verbose=True,
)
template = """<s>[INST] Abaixo está uma instrução que descreve uma tarefa, juntamente com uma entrada que fornece mais contexto.
Escreva uma resposta que complete adequadamente o pedido.
### {question}
[/INST]"""
prompt = PromptTemplate(template=template, input_variables=["question"])
llm_chain = LLMChain(prompt=prompt, llm=llm)
question = "instrução: aja como um professor de matemática e me explique porque 2 + 2 = 4?"
response = llm_chain.run({"question": question})
print(response)
Any idea, help or report will always be welcome.
email: [email protected]
<div style="display:flex; flex-direction:row; justify-content:left"> <a href="https://www.linkedin.com/in/rhaymison-cristian-betini-2b3016175/" target="_blank"> <img src="https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white"> </a> <a href="https://github.com/rhaymisonbetini" target="_blank"> <img src="https://img.shields.io/badge/GitHub-100000?style=for-the-badge&logo=github&logoColor=white"> </a>