Downloads · 30 days
0
CalmaCatLM-1.5-mini
Dmitriy-Zemskov/CalmaCatLM-1.5-mini
CalmaCatLM-1.5-mini is a text generation model from Dmitriy-Zemskov. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
(discord https://discord.gg/DUzP7CXqJt , https://discord.gg/jzwR7jFfSB) Website: https://calmacatai.draklor.ru
Access
Public
Updated Feb 1, 2026
Repo size
210 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth210 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Access
- Public
- Created
- Oct 5, 2025
- Updated
- Feb 1, 2026
- SHA
- 022371e8
Try a prompt
Datasets
Model card
From the Hugging Face model README
(discord https://discord.gg/DUzP7CXqJt , https://discord.gg/jzwR7jFfSB) Website: https://calmacatai.draklor.ru
License
This model is licensed under the MIT License.
CalmaCatLM-1.5-mini
🚧 Experimental Under-Training Model (~12M parameters) based on a custom 12-layer/12-head Transformer architecture.
Primarily supports English 🇬🇧. This is my third model.
📖 Description
CalmaCatLM is an experimental generative language model designed for text generation and dialogue tasks.
The main goal of this project is to test the full pipeline: from implementing the architecture and training from scratch to uploading models to the Hugging Face Hub.
⚙️ Model Details
- Architecture: Custom Transformer Decoder (6 layers, 6 attention heads)
- Model size: ~12M parameters #
- Training Approach: Pre-trained from scratch on My dataset
- Languages: Primarily Russian
- License: MIT
🏋️ Training Details
- Dataset:
My - Hardware: Single AMD RX 7700 XT (12GB VRAM)
- Training Status: Very early checkpoint (Under-trained)
- Epochs: 100
- Batch size: 32
- Optimizer: AdamW, lr = 3e-4
- Max sequence length: 128 tokens
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Languages
- en, ru
- Created
- Oct 5, 2025
- Updated
- Feb 1, 2026