Downloads · 30 days
0
qwen-benchmark-cla10
a22774443/qwen-benchmark-cla10
qwen-benchmark-cla10 is a machine learning model from a22774443. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Benchmark comparing Paperclip Qwen against mission-control using Hugging Face models.
Access
Public
Updated Apr 2, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.py2.6 KB · 36%
At a glance
- Access
- Public
- Created
- Apr 2, 2026
- Updated
- Apr 2, 2026
- SHA
- ba68624d
Model card
From the Hugging Face model README
Qwen Benchmark - CLA-10
Benchmark comparing Paperclip Qwen against mission-control using Hugging Face models.
Environment
- OS: Linux (Ubuntu)
- CPU: AMD EPYC 7763 (2 vCPUs)
- GPU: None (CPU-only)
- Python: 3.12.3
- Runtime: PyTorch + Transformers on CPU
Benchmark Results
| Model | Tokens/sec | Total Tokens | Elapsed (s) |
|---|---|---|---|
| sshleifer/tiny-gpt2 | 219.37 | 512 | 2.33 |
| distilgpt2 | 15.40 | 512 | 33.25 |
| gpt2 | 10.85 | 512 | 47.21 |
Selected Model (Most Efficient)
- Model:
sshleifer/tiny-gpt2 - Throughput: 219.37 tokens/sec
- Device: CPU / torch.float32
Reproduce
# Setup
python3 -m venv .venv
.venv/bin/pip install -r requirements.txt
# Run benchmark
.venv/bin/python benchmark_hf_model.py --model sshleifer/tiny-gpt2 --max-new-tokens 64 --iterations 10 --warmup 2 --out benchmark_result.json
Files
benchmark_hf_model.py- Benchmark scriptrequirements.txt- Python dependenciesbenchmark_tiny_gpt2.json- Results for tiny-gpt2benchmark_distilgpt2.json- Results for distilgpt2benchmark_gpt2.json- Results for gpt2
- Created
- Apr 2, 2026
- Updated
- Apr 2, 2026