Downloads · 30 days
29
2% of all-time downloads
Alittlehammmer/Ornith-1.0-397B-GGUF
Ornith-1.0-397B-GGUF is a text generation model from Alittlehammmer. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as mit.
GGUF quantizations of deepreinforce-ai/Ornith-1.0-397B.
Downloads · 30 days
29
2% of all-time downloads
All-time downloads
1.8K
Public
Repo size
1.4 TB
Likes
4
Public
Click a slice to open those files.
.gguf1.4 TB · 100%
From the Hugging Face model README
GGUF quantizations of deepreinforce-ai/Ornith-1.0-397B.
Converted to BF16 using convert_hf_to_gguf.py, then quantized using llama-quantize from llama.cpp.
Did not use an imatrix for any of these runs, something I want to explore for future model uploads.
| Quant | Bits | Size | Notes |
|---|---|---|---|
| Q4_K_M | 4 | ~241 GB | Recommended |
| Q6_K | 6 | ~326 GB | Very high quality |
| BF16 | 16 | ~793 GB | Full precision, reference file |
Download the shards and run with llama.cpp. The split files are loaded automatically when you point at the first shard:
llama-cli -m Ornith-1.0-397B-Q6_K/Ornith-1.0-397B-Q6_K-00001-of-00007.gguf -p "Hello"
llama.cpp handles the -00001-of-0000X split automatically, so you do not need to merge
the shards manually.
See the original model card for details on capabilities, benchmarks, and license.