Downloads · 30 days
3
4% of all-time downloads
3rd-Order-Continuous-500M
Vincent221/3rd-Order-Continuous-500M
3rd-Order-Continuous-500M is a machine learning model from Vincent221. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A 500M parameter language model with 3rd-order continuous dynamics.
All-time downloads
71
Public
Parameters
648M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 99%
At a glance
- Model type
- 3oc_lm
- Access
- Public
- Created
- Apr 11, 2026
- Updated
- Apr 11, 2026
- SHA
- 848ade92
Model card
From the Hugging Face model README
3rd-Order Continuous LLM 500M
A 500M parameter language model with 3rd-order continuous dynamics.
Non-standard architecture. Custom inference runtime required.
Overview
- Parameters: ~500M
- Hidden size: 1024
- Layers: 28
- Attention: 16 query heads / 4 KV heads
- MLP size: 4096
- Vocabulary size: 151643
- Tokenizer family: Qwen2.5 tokenizer vocabulary
Public Architecture Features
- RoPE positional encoding
- RMSNorm
- Grouped Query Attention (16Q / 4KV)
- SiLU MLP
- bfloat16 weights
Usage
This repository publishes weights only.
It is not expected to run with standard Hugging Face AutoModel pipelines.
The reason is that this model does not follow a standard separation between inference and training. It uses an endogenous control regime without the usual loss-driven runtime split. In short: inference is training. Conceptually this is closer to a TTT-like family of ideas than to a standard frozen LLM runtime, but the mechanism and goals here are different.
At the moment, only these public details are released. If you are interested in higher-order ODE LLMs, request API access, or want to discuss custom runtime/code access, contact:
- Type
- 3oc_lm
- Languages
- en, zh
- Created
- Apr 11, 2026
- Updated
- Apr 11, 2026