Downloads · 30 days
28
42% of all-time downloads
Llama3-RPLoRa-SmaugOrpo
WesPro/Llama3-RPLoRa-SmaugOrpo
Llama3-RPLoRa-SmaugOrpo is a text generation model from WesPro. Use it when you need the model to write or continue text. It is set up for transformers.
This is my previous Llama3 merge (OrpoSmaug-Slerp) with an extra LoRa for better RP on top.
All-time downloads
67
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 20, 2024
- Updated
- Apr 21, 2024
- SHA
- f84216dc
Try a prompt
Model card
From the Hugging Face model README
This is my previous Llama3 merge (OrpoSmaug-Slerp) with an extra LoRa for better RP on top.
Thanks to mradermacher, there are also GGUF quants (Q2_K-Q8_K & IQ3_XS-IQ4_XS) for this model available here: https://huggingface.co/mradermacher/Llama3-RPLoRa-SmaugOrpo-GGUF
base_model:
- WesPro/Llama3-OrpoSmaug-Slerp-8B
- ResplendentAI/RP_Format_Llama3 library_name: transformers tags:
- mergekit
- merge
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: WesPro/Llama3-OrpoSmaug-Slerp-8B+ResplendentAI/RP_Format_Llama3
parameters:
weight: 1.0
merge_method: linear
dtype: float16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 20, 2024
- Updated
- Apr 21, 2024