Downloads · 30 days
11
13% of all-time downloads
SummerGPT2
summerMC/SummerGPT2
SummerGPT2 is a machine learning model from summerMC. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPT Weight-Derived Reservoir language model.
All-time downloads
84
Public
Parameters
10.6M
21.2 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.2 MB · 86%
Parameter types
How the weights are stored.
F1610.6M · 100%
Model card
From the Hugging Face model README
summerMC/SummerGPT2
GPT Weight-Derived Reservoir language model.
Architecture
- Reservoir state: 1024
- Reservoir banks: 8
- Bank dimension: 128
- Latent dimension: 256
- Vocabulary basis rank: 192
- Total parameters: 10,564,049
Loading
from transformers import AutoTokenizer, AutoModelForCausalLM
path = "summerMC/SummerGPT2"
tokenizer = AutoTokenizer.from_pretrained(
path,
trust_remote_code=True,
)
model = AutoModelForCausalLM.from_pretrained(
path,
trust_remote_code=True,
dtype="auto",
)
This repository contains custom Transformers modeling code.
- Type
- gwdr_v6_fast
- Created
- Aug 18, 2026
- Updated
- Aug 18, 2026