Downloads · 30 days
176
4% of all-time downloads
RichardErkhov/jjhsnail0822_-_danube-ko-1.8b-base-gguf
jjhsnail0822_-_danube-ko-1.8b-base-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
176
4% of all-time downloads
All-time downloads
4.7K
Public
Repo size
19 GB
Likes
0
Public
Click a slice to open those files.
.gguf22.4 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
danube-ko-1.8b-base - GGUF
| Name | Quant method | Size |
|---|---|---|
| danube-ko-1.8b-base.Q2_K.gguf | Q2_K | 0.68GB |
| danube-ko-1.8b-base.Q3_K_S.gguf | Q3_K_S | 0.79GB |
| danube-ko-1.8b-base.Q3_K.gguf | Q3_K | 0.87GB |
| danube-ko-1.8b-base.Q3_K_M.gguf | Q3_K_M | 0.87GB |
| danube-ko-1.8b-base.Q3_K_L.gguf | Q3_K_L | 0.94GB |
| danube-ko-1.8b-base.IQ4_XS.gguf | IQ4_XS | 0.97GB |
| danube-ko-1.8b-base.Q4_0.gguf | Q4_0 | 1.01GB |
| danube-ko-1.8b-base.IQ4_NL.gguf | IQ4_NL | 1.02GB |
| danube-ko-1.8b-base.Q4_K_S.gguf | Q4_K_S | 1.01GB |
| danube-ko-1.8b-base.Q4_K.gguf | Q4_K | 1.06GB |
| danube-ko-1.8b-base.Q4_K_M.gguf | Q4_K_M | 1.06GB |
| danube-ko-1.8b-base.Q4_1.gguf | Q4_1 | 1.11GB |
| danube-ko-1.8b-base.Q5_0.gguf | Q5_0 | 1.21GB |
| danube-ko-1.8b-base.Q5_K_S.gguf | Q5_K_S | 1.21GB |
| danube-ko-1.8b-base.Q5_K.gguf | Q5_K | 1.24GB |
| danube-ko-1.8b-base.Q5_K_M.gguf | Q5_K_M | 1.24GB |
| danube-ko-1.8b-base.Q5_1.gguf | Q5_1 | 1.32GB |
| danube-ko-1.8b-base.Q6_K.gguf | Q6_K | 1.43GB |
| danube-ko-1.8b-base.Q8_0.gguf | Q8_0 | 1.85GB |
license: apache-2.0 language:
danube-ko-1.8b-base is a continual pre-trained Korean language model based on h2oai/h2o-danube2-1.8b-base.
Jinhong Jeong, Ungsang Yoon
The vocabulary size was expanded from original 32000 to 40000 to add Korean tokens efficiently. We used the EEVE technique for training. The model has sequence length of 2048. Everything else is the same as the original model.
We used CulturaX, Common Crawl CC-MAIN-2024-10, AI Hub Data, Korean Wikis, Corpora from National Institute of the Korean Language, Standard Korean Dictionary, etc. About 42GB of data was used for training.
This model is ranked #1 in Ko-MMLU on the Open Ko-LLM Leaderboard among pretrained Korean models of size 2B or smaller as of July 5, 2024.
| Task | Value |
|---|---|
| Ko-ARC | 31.74 |
| Ko-HellaSwag | 44.44 |
| Ko-MMLU | 28.06 |
| Ko-TruthfulQA | 41.63 |
| Ko-CommonGen V2 | 32.7 |
| kmmlu_direct | 29.05 |
| kobest | 59.13 |
The Model can generate information that is biased, discriminatory, socially inappropriate, etc. The Model can also generate information that is not accurate. The Model is used at your own risk, and the developers are not responsible for the information generated by the model.