Downloads · 30 days
4
2% of all-time downloads
0x0515/Turjman-RL-merged
Turjman-RL-merged is a translation model from 0x0515. Use it when you need text moved from one language to another.
This is the merged version of Yousefbahr/Turjman-RL, a LoRA adapter fused into Yousefbahr/Turjman-Cold-Start using peft.mergeandunload().
Downloads · 30 days
4
2% of all-time downloads
All-time downloads
170
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This is the merged version of Yousefbahr/Turjman-RL,
a LoRA adapter fused into Yousefbahr/Turjman-Cold-Start
using peft.merge_and_unload().
The merged weights are mathematically identical to running the original LoRA with PEFT. This version is compatible with vLLM for fast batched inference.
from vllm import LLM, SamplingParams
llm = LLM(
model="0x0515/Turjman-RL-merged",
dtype="float16",
tensor_parallel_size=2, # Kaggle 2xT4
gpu_memory_utilization=0.65,
max_model_len=2048,
)