Downloads · 30 days
9
17% of all-time downloads
trrapi-16b
rizla/trrapi-16b
trrapi-16b is a machine learning model from rizla. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as cc-by-nc-nd-4.0.
qlora finetune of frankensteined rizla/rizla-17 model
All-time downloads
53
Public
Parameters
18.8B
51.1 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors37.6 GB · 74%
At a glance
- Library
- peft
- License
- cc-by-nc-nd-4.0
- Model type
- mixtral
- Access
- Public
- Created
- Feb 3, 2024
- Updated
- Feb 3, 2024
- SHA
- 96b27c42
Base models
Model card
From the Hugging Face model README
qlora finetune of frankensteined rizla/rizla-17 model
The original Rizla models, already displaying promising multilingual capabilities, underwent multiple rounds of customization and optimizations to further enhance their versatility across languages. The process involves not only fine-tuned adjustments for better language comprehension but also strategic modifications to the underlying framework itself.
This continual refinement in response to specific requirements exemplifies a dynamic approach towards tackling natural language understanding tasks, where adaptability and flexibility are key factors contributing to performance improvements. In essence, these iterative advancements strive to bridge the gap between generalized pre-trained models and highly specialized applications.
*To run a localhost 127.0.0.1:8080 server with llama.cpp do
wget https://huggingface.co/rizla/trrapi-16b/resolve/main/trrapi-q5km.gguf
git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
./server -m ../trrapi-q5km.gguf --port 8080 -c 2000 -cb -t 8 -ngl 80
- Library
- peft
- Type
- mixtral
- License
- cc-by-nc-nd-4.0
- Created
- Feb 3, 2024
- Updated
- Feb 3, 2024