Downloads · 30 days
119
3% of all-time downloads
llama-3.1-8b-roleplay-jio-gguf
samunder12/llama-3.1-8b-roleplay-jio-gguf
llama-3.1-8b-roleplay-jio-gguf is a text generation model from samunder12. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<div style="width: auto; margin-left: auto; margin-right: auto" <img src="./Jio.jpeg" alt="Peach" style="width: 100%; min-width: 400px; display: block; margin: auto;" </div
All-time downloads
4.2K
Public
Repo size
4.9 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf4.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Sep 1, 2025
- Updated
- Sep 3, 2025
- SHA
- 4249b7a4
Try a prompt
Base models
Model card
From the Hugging Face model README
<div style="width: auto; margin-left: auto; margin-right: auto">
<img src="./Jio.jpeg" alt="Peach" style="width: 100%; min-width: 400px; display: block; margin: auto;">
</div>
<!--
Llama 3.1 8B - Assertive Role-Play (v3 GGUF)
This repository contains the GGUF version of the v3 Assertive Role-Play LoRA model. <!--- <<< Change this link! --->
This model is designed for easy, local inference on CPUs and GPUs using llama.cpp-based software like LM Studio and Ollama.
The model embodies a dominant, assertive, and creative persona for role-playing and storytelling. It was fine-tuned on a multi-turn conversational dataset to enhance its coherence and memory.
Model Details
- Original LoRA Model:
samunder12/llama-3.1-8b-roleplay-v3-lora<!--- <<< Change this link! ---> - Quantization:
Q4_K_M. This method provides an excellent balance between model size, performance, and VRAM/RAM usage. - Context Length:
4096tokens.
Usage Instructions
LM Studio (Recommended)
- Download and install LM Studio.
- In the app, search for this model repo:
samunder12/llama-3.1-8b-roleplay-v3-gguf. <!--- <<< Change this ---> - Download the GGUF file listed in the "Files" tab.
- Go to the Chat tab (💬 icon) and load the model you just downloaded.
- CRITICAL: On the right-hand panel, under "Prompt Format", select the Llama 3 preset.
- Set the
Context Length (n_ctx)to 4096. - Use the "Role-Play" sampler settings below for best results.
Recommended Sampler Settings (Role-Play Preset)
| Setting | Value |
|---|---|
| Temperature | 0.75 |
| Repeat Penalty | 1.06 |
| Mirostat | Mirostat 2.0 |
| top_p | 0.92 |
| top_k | 40 or 100 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Sep 1, 2025
- Updated
- Sep 3, 2025