FinchResearch_-_GTamaraw3-1b-gguf

RichardErkhov/FinchResearch_-_GTamaraw3-1b-gguf

FinchResearch_-_GTamaraw3-1b-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

5% of all-time downloads

All-time downloads

674

Public

Repo size

11.5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf13.5 GB · 100%

At a glance

Access: Public
Created: Oct 29, 2024
Updated: Oct 29, 2024
SHA: c231645f

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

GTamaraw3-1b - GGUF

Model creator: https://huggingface.co/FinchResearch/
Original model: https://huggingface.co/FinchResearch/GTamaraw3-1b/

Name	Quant method	Size
GTamaraw3-1b.Q2_K.gguf	Q2_K	0.42GB
GTamaraw3-1b.Q3_K_S.gguf	Q3_K_S	0.48GB
GTamaraw3-1b.Q3_K.gguf	Q3_K	0.53GB
GTamaraw3-1b.Q3_K_M.gguf	Q3_K_M	0.53GB
GTamaraw3-1b.Q3_K_L.gguf	Q3_K_L	0.56GB
GTamaraw3-1b.IQ4_XS.gguf	IQ4_XS	0.59GB
GTamaraw3-1b.Q4_0.gguf	Q4_0	0.61GB
GTamaraw3-1b.IQ4_NL.gguf	IQ4_NL	0.61GB
GTamaraw3-1b.Q4_K_S.gguf	Q4_K_S	0.61GB
GTamaraw3-1b.Q4_K.gguf	Q4_K	0.64GB
GTamaraw3-1b.Q4_K_M.gguf	Q4_K_M	0.64GB
GTamaraw3-1b.Q4_1.gguf	Q4_1	0.67GB
GTamaraw3-1b.Q5_0.gguf	Q5_0	0.73GB
GTamaraw3-1b.Q5_K_S.gguf	Q5_K_S	0.73GB
GTamaraw3-1b.Q5_K.gguf	Q5_K	0.74GB
GTamaraw3-1b.Q5_K_M.gguf	Q5_K_M	0.74GB
GTamaraw3-1b.Q5_1.gguf	Q5_1	0.79GB
GTamaraw3-1b.Q6_K.gguf	Q6_K	0.85GB
GTamaraw3-1b.Q8_0.gguf	Q8_0	1.1GB

Original model description:

language:

en metrics:
bleu
sacrebleu tags:
en
copilot
code

Training procedure

The following bitsandbytes quantization config was used during training:

quant_method: bitsandbytes
load_in_8bit: False
load_in_4bit: True
llm_int8_threshold: 6.0
llm_int8_skip_modules: None
llm_int8_enable_fp32_cpu_offload: False
llm_int8_has_fp16_weight: False
bnb_4bit_quant_type: nf4
bnb_4bit_use_double_quant: False
bnb_4bit_compute_dtype: float16

Framework versions

PEFT 0.6.0.dev0

Created: Oct 29, 2024
Updated: Oct 29, 2024