Downloads · 30 days
11
6% of all-time downloads
fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF
IntelligentEstate/fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF
fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF is a machine learning model from IntelligentEstate. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
This model was converted to GGUF format from fblgit/miniclaus-qw1.5B-UNAMGS using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
All-time downloads
190
Public
Repo size
1.9 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf1.9 GB · 100%
At a glance
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Dec 18, 2024
- Updated
- Dec 18, 2024
- SHA
- d11170d1
Base models
Model card
From the Hugging Face model README
Still the best little guy for it's size, THANKS for the christmas present FBLGIT/miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF
This model was converted to GGUF format from fblgit/miniclaus-qw1.5B-UNAMGS using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo Intelligentestate/fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF --hf-file miniclaus-qw1.5b-unamgs-q8_0.gguf -p "The meaning to life and the universe is"
GPT4ALL/Ollama: use standard qwen templates/prompting opening context window for length
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Dec 18, 2024
- Updated
- Dec 18, 2024