Downloads · 30 days
24
5% of all-time downloads
Chytrej2-Mini
pvlabs/Chytrej2-Mini
Chytrej2-Mini is a text generation model from pvlabs. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A fully custom pretrained language model built from scratch on the LLaMA architecture trained on 2B tokens of the FineWeb Edu dataset.
All-time downloads
486
Public
Parameters
20.2M
40.3 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors40.3 MB · 95%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Apr 11, 2026
- Updated
- Apr 11, 2026
- SHA
- 226f26ec
Try a prompt
Datasets
Model card
From the Hugging Face model README
Chytrej2-Mini
A fully custom pretrained language model built from scratch on the LLaMA architecture trained on 2B tokens of the FineWeb Edu dataset.
Built by PingVortex Labs.
Model Details
- Parameters: 20M
- Context length: 1024 tokens
- Language: English only
- Format: Base model
- Architecture: LLaMA
- License: Apache 2.0
Benchmark
- The model achieves score of 35.77% on ARC-Easy benchmark.
Usage
from transformers import LlamaForCausalLM, PreTrainedTokenizerFast
model = LlamaForCausalLM.from_pretrained("pvlabs/Chytrej2-Mini")
tokenizer = PreTrainedTokenizerFast.from_pretrained("pvlabs/Chytrej2-Mini")
prompt = "Neural Networks are"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100, repetition_penalty=1.3)
print(tokenizer.decode(outputs[0]))
Made by PingVortex.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Apr 11, 2026
- Updated
- Apr 11, 2026