Downloads · 30 days
10
16% of all-time downloads
Qwen3.5-35B-A3B-DeepMed-6task-SFT-epoch2
Chtholly17/Qwen3.5-35B-A3B-DeepMed-6task-SFT-epoch2
Qwen3.5-35B-A3B-DeepMed-6task-SFT-epoch2 is a image-text-to-text model from Chtholly17. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
SFT of Qwen3.5-35B-A3B on DeepMed distilled trajectories (6 tasks) — end of epoch 2 (global step 420; epoch boundary at step 450). Best-val checkpoint of the run.
All-time downloads
61
Public
Parameters
35.1B
70.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors70.2 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_5_moe
- Access
- Public
- Created
- Apr 23, 2026
- Updated
- Apr 23, 2026
- SHA
- 2050fc89
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-35B-A3B-DeepMed-6task-SFT-epoch2
SFT of Qwen3.5-35B-A3B on DeepMed distilled trajectories (6 tasks) — end of epoch 2 (global step 420; epoch boundary at step 450). Best-val checkpoint of the run.
- Base:
Qwen/Qwen3.5-35B-A3B - Data: 7,204 native-tool-call trajectories (distilled from 6 EHR tasks), filtered at 52K tokens
- Framework: verl + Megatron-Core (TP=2, EP=8, PP=1), bf16, full CPU optimizer offload
- Hyperparameters: lr 2e-5 (cosine), warmup 10 steps, weight decay 0.1, global batch 32
- Train loss: ~0.12 | Val loss: ~0.231 at step 450 (lowest of run)
Companion checkpoint: Chtholly17/Qwen3.5-35B-A3B-DeepMed-6task-SFT-epoch1.
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Apr 23, 2026
- Updated
- Apr 23, 2026