Downloads · 30 days
17
5% of all-time downloads
llama-ca-7B-slerp
ayousanz/llama-ca-7B-slerp
llama-ca-7B-slerp is a text generation model from ayousanz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
llama-ca-7B-slerp is a merge of the following models using mergekit: meta-llama/Llama-2-7b-chat-hf cyberagent/calm2-7b
All-time downloads
340
Public
Parameters
6.7B
13.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jan 12, 2024
- Updated
- Feb 15, 2025
- SHA
- 9e9cdaf5
Try a prompt
Base models
Model card
From the Hugging Face model README
llama-ca-7B-slerp
llama-ca-7B-slerp is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: meta-llama/Llama-2-7b-chat-hf
layer_range: [0, 32]
- model: cyberagent/calm2-7b
layer_range: [0, 32]
merge_method: slerp
base_model: cyberagent/calm2-7b
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Jan 12, 2024
- Updated
- Feb 15, 2025