cockroach54_-_opensolar-qlora-dpo-gguf

RichardErkhov/cockroach54_-_opensolar-qlora-dpo-gguf

cockroach54_-_opensolar-qlora-dpo-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

1% of all-time downloads

All-time downloads

370

Public

Repo size

109 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf128 GB · 100%

At a glance

Access: Public
Created: Nov 7, 2024
Updated: Nov 7, 2024
SHA: c61cb60e

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

opensolar-qlora-dpo - GGUF

Model creator: https://huggingface.co/cockroach54/
Original model: https://huggingface.co/cockroach54/opensolar-qlora-dpo/

Name	Quant method	Size
opensolar-qlora-dpo.Q2_K.gguf	Q2_K	3.79GB
opensolar-qlora-dpo.Q3_K_S.gguf	Q3_K_S	4.41GB
opensolar-qlora-dpo.Q3_K.gguf	Q3_K	4.91GB
opensolar-qlora-dpo.Q3_K_M.gguf	Q3_K_M	4.91GB
opensolar-qlora-dpo.Q3_K_L.gguf	Q3_K_L	5.33GB
opensolar-qlora-dpo.IQ4_XS.gguf	IQ4_XS	5.5GB
opensolar-qlora-dpo.Q4_0.gguf	Q4_0	5.73GB
opensolar-qlora-dpo.IQ4_NL.gguf	IQ4_NL	5.8GB
opensolar-qlora-dpo.Q4_K_S.gguf	Q4_K_S	5.78GB
opensolar-qlora-dpo.Q4_K.gguf	Q4_K	6.1GB
opensolar-qlora-dpo.Q4_K_M.gguf	Q4_K_M	6.1GB
opensolar-qlora-dpo.Q4_1.gguf	Q4_1	6.35GB
opensolar-qlora-dpo.Q5_0.gguf	Q5_0	6.97GB
opensolar-qlora-dpo.Q5_K_S.gguf	Q5_K_S	6.97GB
opensolar-qlora-dpo.Q5_K.gguf	Q5_K	7.16GB
opensolar-qlora-dpo.Q5_K_M.gguf	Q5_K_M	7.16GB
opensolar-qlora-dpo.Q5_1.gguf	Q5_1	7.59GB
opensolar-qlora-dpo.Q6_K.gguf	Q6_K	8.29GB
opensolar-qlora-dpo.Q8_0.gguf	Q8_0	10.74GB

Original model description:

license: apache-2.0 language:

ko
en library_name: transformers datasets:
davidkim205/kollm-converations
davidkim205/kollm-comparision

just for practice

trained by transformers, peft, bitsandbytes
evaluated by https://github.com/davidkim205/kollm_evaluation

base model

beomi/OPEN-SOLAR-KO-10.7B

Tasks	Version	Filter	Metric	Value		Stderr
kobest_wic	1	none	acc	0.4873	±	0.0141
		none	f1	0.3276	±	N/A
kobest_sentineg	1	none	acc	0.6499	±	0.0240
		none	f1	0.6134	±	N/A
kobest_hellaswag	1	none	acc	0.4980	±	0.0224
		none	f1	0.4952	±	N/A
		none	acc_norm	0.6280	±	0.0216
kobest_copa	1	none	acc	0.8030	±	0.0126
		none	f1	0.8026	±	N/A
kobest_boolq	1	none	acc	0.8711	±	0.0089
		none	f1	0.8710	±	N/A
ko_truthfulqa	2	none	acc	0.2717	±	0.0156
ko_hellaswag	1	none	acc	0.4109	±	0.0049
		none	acc_norm	0.5503	±	0.0050
ko_common_gen	1	none	acc	0.9041	±	0.0075
		none	acc_norm	0.9041	±	0.0075
ko_arc_easy	1	none	acc	0.3490	±	0.0139
		none	acc_norm	0.4326	±	0.0145

Created: Nov 7, 2024
Updated: Nov 7, 2024