Downloads · 30 days
271
2% of all-time downloads
intervitens-archive/internlm2-limarp-chat-20b-GGUF
internlm2-limarp-chat-20b-GGUF is a text generation model from intervitens-archive. Use it when you need the model to write or continue text. The card lists the license as other.
Experimental model, LimaRP LoRA trained on top of internlm2-base-20b with 8192 context length and merged with internlm2-chat-20b.
Downloads · 30 days
271
2% of all-time downloads
All-time downloads
14.6K
Public
Repo size
215 GB
Likes
3
Public
Click a slice to open those files.
.gguf207 GB · 100%
From the Hugging Face model README
Experimental model, LimaRP LoRA trained on top of internlm2-base-20b with 8192 context length and merged with internlm2-chat-20b.
Prompt format is ChatML.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the task arithmetic merge method using intervitens/internlm2-base-20b-llama as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: ./internlm2-chat-20b-llama
parameters:
weight: 1.0
- model: ./internlm2-limarp-20b-v0.03
parameters:
weight: 0.6
merge_method: task_arithmetic
base_model: ./internlm2-base-20b-llama
parameters:
#normalize: false
#int8_mask: true
dtype: bfloat16