Downloads · 30 days
11
4% of all-time downloads
PhoGPT-4B-Chat
tom1669/PhoGPT-4B-Chat
PhoGPT-4B-Chat is a machine learning model from tom1669. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF format files of the model vinai/PhoGPT-4B-Chat.
All-time downloads
284
Public
Repo size
7.4 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf7.4 GB · 100%
At a glance
- Access
- Public
- Created
- Feb 27, 2024
- Updated
- Feb 28, 2024
- SHA
- fb412e2c
Model card
From the Hugging Face model README
GGUF format files of the model vinai/PhoGPT-4B-Chat.
This model file is compatible with the latest llama.cpp
Context: I was trying to get PhoGPT to work with llama-cpp and llama-cpp-python. I found nguyenviet/PhoGPT-4B-Chat-GGUF but cannot get it to work:
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="nguyenviet/PhoGPT-4B-Chat-GGUF",
filename="*q3_k_m.gguf*",
)
...
llama_model_load: error loading model: done_getting_tensors: wrong number of tensors; expected 388, got 387
llama_load_model_from_file: failed to load model
...
After my opening issue at the PhoGPT repo was resolved, I was able to create the gguf file.
I figure people want to try the model in Colab. So here it is, so you don't have to create it yourself
- Created
- Feb 27, 2024
- Updated
- Feb 28, 2024