Downloads · 30 days
39
5% of all-time downloads
Qwen35-0.8B-FlyFFN-v3-AllFFN
vtava/Qwen35-0.8B-FlyFFN-v3-AllFFN
Qwen35-0.8B-FlyFFN-v3-AllFFN is a text generation model from vtava. Use it when you need the model to write or continue text. It is set up for transformers.
Research artifact from TinyCeNN-LM. Architecture: Qwen3.5-0.8B + FlyFFN-v3 on all 24 FFNs (no dense anchors).
All-time downloads
736
Public
Repo size
6.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt2 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen3_5_text
- Access
- Public
- Created
- Sep 18, 2026
- Updated
- Sep 19, 2026
- SHA
- a028ea89
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen35-0.8B-FlyFFN-v3-AllFFN
Research artifact from TinyCeNN-LM. Architecture: Qwen3.5-0.8B + FlyFFN-v3 on all 24 FFNs (no dense anchors).
Architecture
- Architecture/run type:
Qwen3.5-0.8B + FlyFFN-v3 on all 24 FFNs (no dense anchors) - Base model:
Qwen/Qwen3.5-0.8B - Dataset:
Not recorded - Source code: https://github.com/vtavakkoli/TinyCeNN-LM
Latest saved results
| Metric | Value |
|---|---|
num_shards | 8 |
mean_route_mix | 0.231608 |
The Hugging Face repository keeps timestamped run artifacts under runs/. This preserves training reports, configs and run metadata independently of the temporary Colab filesystem.
Saved experiment files
.hf_run_archive/standalone-20260919T081146Z/config.json.hf_run_archive/standalone-20260919T081146Z/flyffn_config.json.hf_run_archive/standalone-20260919T081146Z/generation_config.json.hf_run_archive/standalone-20260919T081146Z/report.json.hf_run_archive/standalone-20260919T081146Z/tokenizer_config.jsonconfig.jsonflyffn_config.jsongeneration_config.jsonreport.jsontokenizer_config.json
Reproducibility
Run the matching notebook from the TinyCeNN-LM repository. Colab notebooks use a Hugging Face write token from the HF_TOKEN Colab Secret; tokens should never be pasted into notebook source.
Limitations
This is a research checkpoint. Metrics saved here are the metrics produced by the corresponding training notebook/script; unless explicitly marked as held-out evaluation, they should not be treated as publication-grade benchmark results. Generation quality can differ substantially from the base model.
Citation
If you use this experimental checkpoint, cite the TinyCeNN-LM repository and the upstream base model.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_text
- Created
- Sep 18, 2026
- Updated
- Sep 19, 2026