Downloads · 30 days
4
8% of all-time downloads
TheTsar1209/llama3-carp-v0.4.1
llama3-carp-v0.4.1 is a text generation model from TheTsar1209. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
4
8% of all-time downloads
All-time downloads
52
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
A Fishy Model
This model was trained on a special ChatML format with 8k context.
There are 3 different response tokens that can be used.
You can use this one if you want a medium length response. ( Greater than 64 and less than 256 tokens )
<|im_start|>assistant\n
This one if you want a short length response. ( Less than 64 tokens )
<|im_start|>assistantshort\n
This one if you want a long response. ( Greater than 256 tokens )
<|im_start|>assistantlong\n
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.