Downloads · 30 days
0
HRM-Text1-UltraChat
Viharikvs/HRM-Text1-UltraChat
HRM-Text1-UltraChat is a machine learning model from Viharikvs. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
HRM-Text1 is an experimental instruction-following text generation model based on the Hierarchical Recurrent Memory (HRM) architecture. It is trained on the databricks/databricks-dolly-15k dataset, which consists of i…
Access
Public
Updated Oct 3, 2025
Repo size
64.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt334 MB · 67%
At a glance
- Access
- Public
- Created
- Oct 2, 2025
- Updated
- Oct 3, 2025
- SHA
- 4bea19cd
Base models
Model card
From the Hugging Face model README
HRM-Text1
HRM-Text1 is an experimental instruction-following text generation model based on the Hierarchical Recurrent Memory (HRM) architecture. It is trained on the databricks/databricks-dolly-15k dataset, which consists of instruction–response pairs across multiple task types.
The model utilizes the HRM structure, consisting of a "Specialist" module for low-level processing and a "Manager" module for high-level abstraction and planning. This architecture aims to handle long-range dependencies more effectively by summarizing information at different temporal scales.
Model Description
- Architecture: Hierarchical Recurrent Memory (HRM)
- Training Data: databricks/databricks-dolly-15k
- Original Paper: Hierarchical Reasoning Model
- Tokenizer:
t5-small(slow T5 SentencePiece) - Vocab Size: 32100
- Objective: Causal Language Modeling
Latest Performance (Epoch 20)
- Validation Loss:
3.6668 - Validation Perplexity:
39.13
- Created
- Oct 2, 2025
- Updated
- Oct 3, 2025