Downloads · 30 days
18
5% of all-time downloads
gemma-3-110m-english-only-old
qikp/gemma-3-110m-english-only-old
gemma-3-110m-english-only-old is a text generation model from qikp. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
This is Gemma 3 270M with the pika 3 tokenizer used and with retrained embedding and output layers, afterwards a gentle retrain.
All-time downloads
341
Public
Parameters
110M
440 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors440 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Model type
- gemma3_text
- Access
- Public
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026
- SHA
- b493c66d
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma 3 110M English Only
This is Gemma 3 270M with the pika 3 tokenizer used and with retrained embedding and output layers, afterwards a gentle retrain.
Chat template
Note: This uses the Zephyr chat template.
Training
It was trained on these using 1 epoch, sparse adam optimizer, and 32 batch size:
- HuggingFaceTB/cosmopedia-20k
- HuggingFaceTB/smol-smoltalk (first 23,000 rows)
- HuggingFaceTB/everyday-conversations-llama3.1-2k
Limitations
The quality of this model needs to be better tested. It will also poorly handle non-English languages.
- Task
- Text Generation
- Library
- transformers
- Type
- gemma3_text
- License
- gemma
- Languages
- en
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026