Downloads · 30 days
225
11% of all-time downloads
prithivMLmods/cogito-v1-preview-llama-3B-f32-GGUF
cogito-v1-preview-llama-3B-f32-GGUF is a text generation model from prithivMLmods. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
Cogito v1 preview - 3B is a 3 billion parameter hybrid reasoning language model built on the Llama 3.2 architecture and developed by DeepCogito, uniquely designed to operate in both standard and deep “self-reflective”…
Downloads · 30 days
225
11% of all-time downloads
All-time downloads
2K
Public
Repo size
46.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf46.7 GB · 100%
From the Hugging Face model README
Cogito v1 preview - 3B is a 3 billion parameter hybrid reasoning language model built on the Llama 3.2 architecture and developed by DeepCogito, uniquely designed to operate in both standard and deep “self-reflective” reasoning modes through Iterated Distillation and Amplification (IDA), supporting 128k context windows and over 30 languages, and optimized for coding, STEM, multilingual tasks, tool-calling, and instruction following, consistently outperforming other models of similar size on industry benchmarks while being available under an open license for commercial use.
| File name | Size | Quant type |
|---|---|---|
| cogito-v1-preview-llama-3B.F32.gguf | 12.9 GB | F32 |
| cogito-v1-preview-llama-3B.BF16.gguf | 6.43 GB | BF16 |
| cogito-v1-preview-llama-3B.F16.gguf | 6.43 GB | F16 |
| cogito-v1-preview-llama-3B.Q8_0.gguf | 3.42 GB | Q8_0 |
| cogito-v1-preview-llama-3B.Q6_K.gguf | 2.64 GB | Q6_K |
| cogito-v1-preview-llama-3B.Q5_K_M.gguf | 2.32 GB | Q5_K_M |
| cogito-v1-preview-llama-3B.Q5_K_S.gguf | 2.27 GB | Q5_K_S |
| cogito-v1-preview-llama-3B.Q4_K_M.gguf | 2.02 GB | Q4_K_M |
| cogito-v1-preview-llama-3B.Q4_K_S.gguf | 1.93 GB | Q4_K_S |
| cogito-v1-preview-llama-3B.Q3_K_L.gguf | 1.82 GB | Q3_K_L |
| cogito-v1-preview-llama-3B.Q3_K_M.gguf | 1.69 GB | Q3_K_M |
| cogito-v1-preview-llama-3B.Q3_K_S.gguf | 1.54 GB | Q3_K_S |
| cogito-v1-preview-llama-3B.Q2_K.gguf | 1.36 GB | Q2_K |
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
