Downloads · 30 days
122
3% of all-time downloads
gpt2-chatml-fp32-GGUF
JustACluelessKid2/gpt2-chatml-fp32-GGUF
gpt2-chatml-fp32-GGUF is a machine learning model from JustACluelessKid2. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This repository contains GGUF quantized models converted from the fine-tuned JustACluelessKid2/gpt2-chatml-fp32.
All-time downloads
3.7K
Public
Repo size
2.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf945 MB · 99%
At a glance
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- May 22, 2026
- Updated
- May 23, 2026
- SHA
- b03653e4
Base models
Datasets
Model card
From the Hugging Face model README
GPT-2 ChatML GGUF (no_robots SFT)
This repository contains GGUF quantized models converted from the fine-tuned JustACluelessKid2/gpt2-chatml-fp32.
Models Available
gpt2-f32.gguf(252.5 MB) - Baseline F16-Embedding GGUFggml-model-Q8_0.gguf(136.7 MB) - High-fidelity 8-bit quantizationggml-model-IQ4_NL.gguf(84.8 MB) - Highly-optimized 4-bit non-linear quantizationggml-model-IQ4_XS.gguf(82.2 MB) - Imatrix optimized 4-bit quantizationggml-model-Q6_K.gguf(106.7 MB) - High-quality 6-bit quantizationggml-model-Q5_K_M.gguf(98.8 MB) - High-quality 5-bit quantizationggml-model-IQ3_XXS.gguf(64.8 MB) - Imatrix 3-bit quantization (Chromebook-compatible)ggml-model-IQ2_M.gguf(62.5 MB) - Imatrix optimized 2-bit quantizationggml-model-IQ2_XXS.gguf(55.5 MB) - Ultra-low 2-bit quantization
These models were calibrated using an importance matrix computed on 1,000 shuffled conversational sequences.
- Type
- gpt2
- License
- mit
- Created
- May 22, 2026
- Updated
- May 23, 2026