Downloads · 30 days
74
13% of all-time downloads
federicofts/Fallen-Gemma3-27B-v1-vllm-config
Fallen-Gemma3-27B-v1-vllm-config is a machine learning model from federicofts. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Config-only repo. TheDrummer/Fallen-Gemma3-27B-v1 ships a config.json with the Gemma3-12B textconfig (hiddensize 3840) while the weights are 27B (hiddensize 5376), which crashes vLLM at weight load. This repo is that…
Downloads · 30 days
74
13% of all-time downloads
All-time downloads
564
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 44%
From the Hugging Face model README
Config-only repo. TheDrummer/Fallen-Gemma3-27B-v1 ships a config.json with the Gemma3-12B text_config (hidden_size 3840) while the weights are 27B (hidden_size 5376), which crashes vLLM at weight load. This repo is that config.json with text_config replaced by the correct gemma-3-27b-it values. Use with vLLM: --model TheDrummer/Fallen-Gemma3-27B-v1 --hf-config-path federicofts/Fallen-Gemma3-27B-v1-vllm-config