Downloads · 30 days
20
0% of all-time downloads
R1-Distill-Qwen-14B-Roblox-Luau
TorpedoSoftware/R1-Distill-Qwen-14B-Roblox-Luau
R1-Distill-Qwen-14B-Roblox-Luau is a text generation model from TorpedoSoftware. Use it when you need the model to write or continue text. The card lists the license as mit.
A fine tune of deepseek-ai/DeepSeek-R1-Distill-Qwen-14B using boatbomber/roblox-info-dump and boatbomber/the-luau-stack for Roblox domain knowledge.
All-time downloads
11.9K
Public
Parameters
14.8B
59.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors59.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- qwen2
- Access
- Public
- Created
- Mar 1, 2025
- Updated
- Dec 6, 2025
- SHA
- e436b273
Try a prompt
Base models
Model card
From the Hugging Face model README
R1-Distill-Qwen-14B-Roblox-Luau
A fine tune of deepseek-ai/DeepSeek-R1-Distill-Qwen-14B using boatbomber/roblox-info-dump and boatbomber/the-luau-stack for Roblox domain knowledge.
Recommended inference settings:
| Parameter | Value | Notes |
|---|---|---|
| System Prompt | You are an expert Roblox developer and Luau software engineer. | Model was fine tuned with this prompt. |
| temperature | 0.5-0.7 | Underlying R1 Distill uses this. I've found best results with 0.55. |
| top_p | 0.95 | Underlying R1 Distill uses this. |
Quantization done using Unsloth.
Available quants:
| Quant | Size | Notes |
|---|---|---|
| F16 | 29.55GB | Retains 100% accuracy. Slow and memory hungry. |
| Q8_O | 15.70GB | High resource use, but generally acceptable. Use when accuracy is crucial. |
| Q6_K | 12.12GB | Uses Q6_K for all tensors. Good for high end GPUs. |
| Q5_K_M | 10.51GB | Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q5_K |
| Q4_K_M | 8.99GB | Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K |
| Q3_K_M | 7.34GB | Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K. Quality is noticeably degraded. |
- Task
- Text Generation
- Type
- qwen2
- License
- mit
- Languages
- en
- Featherless Ai
- live
- Created
- Mar 1, 2025
- Updated
- Dec 6, 2025