Downloads · 30 days
37
8% of all-time downloads
Scicom-intl/gpt-oss-20b-Malaysian-Reasoning-SFT-v0.1
gpt-oss-20b-Malaysian-Reasoning-SFT-v0.1 is a text generation model from Scicom-intl. Use it when you need the model to write or continue text. It is set up for transformers.
LoRA SFT openai/gpt-oss-20b on initial mesolitica/Malaysian-Reasoning
Downloads · 30 days
37
8% of all-time downloads
All-time downloads
489
Public
Parameters
20.9B
60.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors55.6 GB · 100%
From the Hugging Face model README
LoRA SFT openai/gpt-oss-20b on initial mesolitica/Malaysian-Reasoning
kernels-community/vllm-flash-attn3 for Flash Attention 3 with Sink.exp_avg_sq, top 4 selected layers are 3, 2, 18, and 1. <sup> + </sup><sup> + </sup> with the rank of each equal to the total rank divided by the number of active experts, https://thinkingmachines.ai/blog/lora/
This model repository we only upload the best, only attention linear layers with rank 256 alpha 512.
Source code at https://github.com/Scicom-AI-Enterprise-Organization/small-ablation/blob/main/malaysian-reasoning
Special thanks to https://www.scitix.ai/ for H100 Node!