Downloads · 30 days
215K
71% of all-time downloads
Llama-3-Kimodo-GGML
LocalAI-io/Llama-3-Kimodo-GGML
Llama-3-Kimodo-GGML is a machine learning model from LocalAI-io. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for ggml. The card lists the license as other.
Native GGML/GGUF text encoder used by Kimodo. This is the reusable LLM2Vec encoder only; download a matching Kimodo diffusion model separately, for example Kimodo-SMPLX-RP-v1-GGML.
All-time downloads
304K
Public
Repo size
59.6 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf59.6 GB · 100%
At a glance
- Library
- ggml
- License
- other
- Access
- Public
- Created
- Aug 23, 2026
- Updated
- Sep 17, 2026
- SHA
- 3e8d9588
Model card
From the Hugging Face model README
Llama-3-Kimodo-GGML
Native GGML/GGUF text encoder used by Kimodo. This is the
reusable LLM2Vec encoder only; download a matching Kimodo diffusion model
separately, for example
Kimodo-SMPLX-RP-v1-GGML.
From a kimodo.cpp checkout with the Hugging Face CLI installed, install both with:
scripts/download_gguf_weights.sh --output "$PWD"
The downloader installs the recommended Q8_0 variant by default. Select a
different one with --text-quantization bf16|q8_0|q6_k|q5_k|q4_k|q4_k_m.
Every variant is one monolithic weight GGUF and uses the same tokenizer.gguf.
Kimodo reads individual tensor ranges from the monolith, so streaming one layer
at a time does not require separate per-layer files.
| Variant | Weight file | Size (GB) | Intended use |
|---|---|---|---|
| BF16 | Llama-3-Kimodo-BF16.gguf | 15.18 | Reference |
| Q8_0 | Llama-3-Kimodo-Q8_0.gguf | 8.14 | Recommended |
| Q6_K | Llama-3-Kimodo-Q6_K.gguf | 6.32 | Experimental |
| Q5_K | Llama-3-Kimodo-Q5_K.gguf | 5.33 | Experimental |
| Q4_K | Llama-3-Kimodo-Q4_K.gguf | 4.39 | Experimental |
| Q4_K_M | Llama-3-Kimodo-Q4_K_M.gguf | 5.06 | Preferred low-bit experiment |
The legacy split BF16 tree remains temporarily available for older clients.
Provenance and licence
The bundle is converted from Meta Llama-3-8B-Instruct and the MIT-licensed McGill LLM2Vec MNTP and supervised adapters. Built with Meta Llama 3.
LICENSE-META-LLAMA-3.txt and NOTICE accompany this distribution. Review
the Meta Llama 3 Community License
before use or redistribution. MANIFEST.json records the exact source commits
and SHA-256 of every published artifact, plus the weight/tokenizer mapping for
each quantization.
- Library
- ggml
- License
- other
- Created
- Aug 23, 2026
- Updated
- Sep 17, 2026