Downloads · 30 days
80
5% of all-time downloads
iandennismiller/samantha-1.1-llama-33b-GGUF
samantha-1.1-llama-33b-GGUF is a machine learning model from iandennismiller. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Samantha 1.1 is a very smart model. For those of us with 24gb usable RAM (including Apple Silicon with 32gb RAM), this is just about the best model available as of October, 2023.
Downloads · 30 days
80
5% of all-time downloads
All-time downloads
1.7K
Public
Repo size
64.6 GB
Likes
5
Public
Click a slice to open those files.
.gguf64.6 GB · 100%
From the Hugging Face model README
Samantha 1.1 is a very smart model. For those of us with 24gb usable RAM (including Apple Silicon with 32gb RAM), this is just about the best model available as of October, 2023.
I've converted the model to GGUF for the sake of compatibility. Currently, only Q4_K_S is available because that's the largest model that runs in 24gb.
For more information, see Eric Hartford's Samantha 1.1 Llama 33B. To examine the original quant, see TheBloke/samantha-1.1-llama-33B-GGML
The particular quants selected for this repo are in support of calm, which is a language model runner that automatically uses the right prompts, templates, context size, etc.