Rooja

Rooja

Rooja is a fine-tuned version of Qwen2.5-7B-Instruct, specialized for FiveM development, Lua scripting, QBCore, and GTA V server development.

Rooja is designed to act as a coding assistant for developers building and maintaining FiveM resources.

Model Details

Training Dataset

The training run contained:

• 5,969 total examples
• 4,460 training examples
• 1,509 validation examples

The dataset was created for FiveM-oriented coding and development tasks.

Training Results

Final training results:

The training run completed successfully after 2 epochs.

What Rooja Is Designed For

Rooja is intended to help with:

• FiveM Lua development
• QBCore scripting
• GTA V server development
• Client-side Lua
• Server-side Lua
• FiveM resources
• fxmanifest.lua
• QBCore events and callbacks
• Player and character systems
• Server/client communication
• Configuration files
• Debugging
• Code explanation
• Code generation
• Resource architecture
• FiveM development workflows

Example Prompt

Create a QBCore FiveM server-side command that gives
cash to another player.

Validate the target player and amount and make sure the
command cannot be abused with invalid values.

Usage

Transformers

from transformers import AutoTokenizer, AutoModelForCausalLM

model_id = "lone17k/Rooja"

tokenizer = AutoTokenizer.from_pretrained(model_id)

model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype="auto",
    device_map="auto"
)

messages = [
    {
        "role": "user",
        "content": "Create a basic FiveM QBCore server-side command."
    }
]

text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)

inputs = tokenizer(
    text,
    return_tensors="pt"
).to(model.device)

outputs = model.generate(
    **inputs,
    max_new_tokens=512,
    temperature=0.2
)

response = tokenizer.decode(
    outputs[0][inputs["input_ids"].shape[-1]:],
    skip_special_tokens=True
)

print(response)

Recommended Generation Settings

For code generation, a low temperature is recommended.

temperature: 0.1 - 0.3
top_p: 0.8 - 0.95

For deterministic coding:

temperature: 0.2

Limitations

Rooja may generate incorrect, incomplete, or outdated FiveM and QBCore APIs.

FiveM resources and frameworks can change over time. Generated code should therefore be reviewed and tested before being deployed to a production server.

Rooja should be treated as a coding assistant and not as an authoritative source of FiveM documentation.

Base Model

Rooja is based on:

Qwen/Qwen/Qwen2.5-7B-Instruct

The original Qwen/Qwen2.5-7B-Instruct model contains approximately 14.7B parameters and supports long-context usage. Its Hugging Face model card currently identifies the model as Apache-2.0 licensed.

For the original model and its license, see:

https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct

Creator

Created and fine-tuned by Lone17k.

Hugging Face:

https://huggingface.co/lone17k

Model:

https://huggingface.co/lone17k/Rooja

Disclaimer

This project is an independent fine-tune and is not affiliated with Qwen, Alibaba Cloud, FiveM, or Rockstar Games.