Downloads · 30 days
0
Turkish-Gemma-9b-T1-1bit
suayptalha/Turkish-Gemma-9b-T1-1bit
Turkish-Gemma-9b-T1-1bit is a machine learning model from suayptalha. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for nanoquant. The card lists the license as gemma.
This repository contains a NanoQuant-compressed checkpoint derived from ytu-ce-cosmos/Turkish-Gemma-9b-T1.
Access
Public
Updated Jul 18, 2026
Repo size
2.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt2.9 GB · 100%
At a glance
- Library
- nanoquant
- License
- gemma
- Access
- Public
- Created
- Jul 18, 2026
- Updated
- Jul 18, 2026
- SHA
- b4b0f772
Base models
Model card
From the Hugging Face model README
Turkish-Gemma-9b-T1 NanoQuant 1-bit
This repository contains a NanoQuant-compressed checkpoint derived from
ytu-ce-cosmos/Turkish-Gemma-9b-T1.
Quantization details
- Method: NanoQuant
- Target linear-weight bitrate: 1.0 bit
- Sequence length: 2048
- Calibration samples: 64
- English calibration samples: 32
- Turkish calibration samples: 32
- Non-factorized epochs: 2
- Factorized epochs: 2
- ADMM outer iterations: 100
- Seed: 42
- Quantization hardware: NVIDIA A100 80 GB
Model-level knowledge-distillation tuning was performed after layer compression. The tuning loss decreased from 1.9244 to 1.7136 over 8 reported epochs.
Important
This file is a NanoQuant checkpoint. It is not a GGUF file and is not a
standard Transformers save_pretrained checkpoint.
It requires the NanoQuant code and compatible CUDA kernels for loading and
inference. It cannot be loaded directly with llama.cpp, Ollama, vLLM, or
AutoModelForCausalLM.from_pretrained().
Files
Turkish-Gemma-9b-T1-NanoQuant-1bit-en32-tr32.pt: compressed checkpoint
Base-model license
Use of this checkpoint remains subject to the license and usage terms of the original Gemma-based model.
- Library
- nanoquant
- License
- gemma
- Languages
- tr, en
- Created
- Jul 18, 2026
- Updated
- Jul 18, 2026