chyon_gemma_4_gguf

arabellako22/chyon_gemma_4_gguf

chyon_gemma_4_gguf is a machine learning model from arabellako22. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as gemma.

Status: not recommended. This earlier GGUF release was converted from the legacy full merge, which failed the recorded generation smoke test by repeatedly emitting prompt-template tokens.

Downloads · 30 days

19% of all-time downloads

All-time downloads

393

Public

Repo size

7.1 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf7.1 GB · 100%

At a glance

Library: llama.cpp
License: gemma
Access: Public
Created: Jun 20, 2026
Updated: Oct 13, 2026
SHA: 23aaaa54

Base models

unsloth/gemma-4-E2B-it

Model card

From the Hugging Face model README

Chyon Gemma 4 GGUF — Legacy

Status: not recommended. This earlier GGUF release was converted from the legacy full merge, which failed the recorded generation smoke test by repeatedly emitting prompt-template tokens.

Use the verified Chyon GGUF v2 release instead.

Key facts

Field	Value
Original base	unsloth/gemma-4-E2B-it
LoRA adapter	arabellako22/chyon_lora_model
Conversion source	arabellako22/chyon_merged_full_gemma_4_legacy
Format	GGUF for llama.cpp-compatible runtimes
License	Gemma license

Files

chyon-gemma-4.Q4_K_M.gguf
chyon-gemma-4.Q5_K_M.gguf

Why this repository is retained

The files remain available for reproducibility and comparison. They should not be used for deployment or evaluation of the current Chyon model.

The verified v2 release was produced from the Unsloth 16-bit re-merge, tested locally, uploaded, downloaded again, and retested.

Limitations

The source full-weight merge failed its recorded generation smoke test.
No standardized factuality, safety, bias, robustness, or Korean benchmark is published.
English and multimodal behavior were not separately validated.
Quantization may further alter output quality.

Use the verified v2 release for local inference.

Library: llama.cpp
License: gemma
Languages: ko, en
Created: Jun 20, 2026
Updated: Oct 13, 2026