Downloads · 30 days
729
6% of all-time downloads
LGAI-EXAONE/K-EXAONE-236B-A23B-GGUF
K-EXAONE-236B-A23B-GGUF is a text generation model from LGAI-EXAONE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
<br <br <p align="center" <img src="assets/K-EXAONElogogray.png" width="400" <br <br <br
Downloads · 30 days
729
6% of all-time downloads
All-time downloads
11.8K
Public
Repo size
1.4 TB
Likes
19
Public
Click a slice to open those files.
.gguf1.4 TB · 100%
From the Hugging Face model README
We introduce K-EXAONE, a large-scale multilingual language model developed by LG AI Research. Built using a Mixture-of-Experts architecture, K-EXAONE features 236 billion total parameters, with 23 billion active during inference. Performance evaluations across various benchmarks demonstrate that K-EXAONE excels in reasoning, agentic capabilities, general knowledge, multilingual understanding, and long-context processing.
For more details, please refer to the technical report, blog and GitHub.

Q8_0, Q6_K, Q5_K_M, Q4_K_M, IQ4_XS in GGUF format (also includes BF16 weights)The evaluation results of the original model against other models are available on the GitHub page or in the model card of the original model. Detailed evaluation configurations and results can be found in the technical report.
K-EXAONE is supported by multiple libraries. Please install the required libraries as needed for your use case.
You should install transformers >= 5.1.0 for the K-EXAONE model.
To use the K-EXAONE model with llama.cpp library, you should install llama.cpp >= b7737.
You should install the llama.cpp library with the version of b7737 or after.
After you install the library, you need to prepare a model file in GGUF format as below:
# Download GGUF model weights (e.g. Q4_K_M)
hf download LGAI-EXAONE/K-EXAONE-236B-A23B-GGUF --include "*Q4_K_M*" --local-dir .
# Or convert huggingface model into GGUF format on your own
hf download LGAI-EXAONE/K-EXAONE-236B-A23B --local-dir $YOUR_MODEL_DIR
python convert_hf_to_gguf.py $YOUR_MODEL_DIR --outtype bf16 --outfile K-EXAONE-236B-A23B-BF16.gguf
# If you want to use the lower precision than BF16, you need to quantize the model
./llama-quantize K-EXAONE-236B-A23B-BF16.gguf K-EXAONE-236B-A23B-Q4_K_M.gguf Q4_K_M
You can test the model with simple chat CLI by running the command below:
./llama-cli -m K-EXAONE-236B-A23B-Q4_K_M.gguf \
-ngl 99 \
-fa on -sm row \
--temp 1.0 --top-p 0.95 --min-p 0 \
-c 131072 -n 32768 \
--no-context-shift \
--jinja
You can also launch a server by running the command below:
./llama-server -m K-EXAONE-236B-A23B-Q4_K_M.gguf \
-ngl 99 \
-fa on -sm row \
--temp 1.0 --top-p 0.95 --min-p 0 \
-c 131072 -n 32768 \
--no-context-shift \
--jinja \
--host 0.0.0.0 --port 8080
When the server is ready, you can test the model using the chat-style UI at http://localhost:8080, and access the OpenAI-compatible API at http://localhost:8080/v1.
Ollama and LM-Studio are powered by llama.cpp, so they should be updated once llama.cpp officially supports K-EXAONE. We will update this section once each library supports K-EXAONE.
[!IMPORTANT] To achieve the expected performance, we recommend using the following configurations:
- We strongly recommend to use
temperature=1.0,top_p=0.95,presence_penalty=0.0for best performance.- Different from EXAONE-4.0, K-EXAONE uses
enable_thinking=Trueas default. Thus, you need to setenable_thinking=Falsewhen you want to use non-reasoning mode.
The K-EXAONE language model has certain limitations and may occasionally generate inappropriate responses. The language model generates responses based on the output probability of tokens, and it is determined during learning from training data. While we have made every effort to exclude personal, harmful, and biased information from the training data, some problematic content may still be included, potentially leading to undesirable responses. Please note that the text generated by K-EXAONE language model does not reflect the views of LG AI Research.
LG AI Research strives to reduce potential risks that may arise from K-EXAONE language models. Users are not allowed to engage in any malicious activities (e.g., keying in illegal information) that may induce the creation of inappropriate outputs violating LG AI's ethical principles when using K-EXAONE language models.
The model is licensed under K-EXAONE AI Model License Agreement
@article{k-exaone,
title={K-EXAONE Technical Report},
author={{LG AI Research}},
journal={arXiv preprint arXiv:2601.01739},
year={2025}
}
LG AI Research Technical Support: [email protected]