Downloads · 30 days
824
21% of all-time downloads
Basilisk-4B-gguf
Aryanne/Basilisk-4B-gguf
Basilisk-4B-gguf is a text generation model from Aryanne. Use it when you need the model to write or continue text. It is set up for transformers.
GGML/GGUF(v2) Quantizations of the model: https://huggingface.co/winglian/basilisk-4b This is winglian/llama-2-4b, a 4B parameter Llama-2 model, finetuned with open orca CoT data.
All-time downloads
3.9K
Public
Repo size
14 GB
Likes
11
Public
Repo makeup
Click a slice to open those files.
.gguf14 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Sep 23, 2023
- Updated
- Oct 5, 2023
- SHA
- aba26fa0
Try a prompt
Datasets
Model card
From the Hugging Face model README
GGML/GGUF(v2) Quantizations of the model: https://huggingface.co/winglian/basilisk-4b This is winglian/llama-2-4b, a 4B parameter Llama-2 model, finetuned with open orca CoT data.
I tried to run on latest llama.cpp commit, but I was getting an error(GGML_ASSERT: llama.cpp:8136: false), then I converted again the model to gguf using this llama.cpp commit https://github.com/ggerganov/llama.cpp/tree/019ba1dcd0c7775a5ac0f7442634a330eb0173cc it seems to be working now.
- Task
- Text Generation
- Library
- transformers
- Created
- Sep 23, 2023
- Updated
- Oct 5, 2023