Downloads · 30 days
7
4% of all-time downloads
Llama_Passthrough
r3ddox/Llama_Passthrough
Llama_Passthrough is a text generation model from r3ddox. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
LlamaPassthrough is a merged LLM using the following models using mergekit: Suchinthana/Sinhala-Translate-and-Dolly-Llama-7b austinm2151/Llama2-7b-Summarizer
All-time downloads
182
Public
Parameters
8.4B
16.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- May 20, 2024
- Updated
- May 20, 2024
- SHA
- 1955b590
Try a prompt
Model card
From the Hugging Face model README
Llama_Passthrough
Llama_Passthrough is a merged LLM using the following models using mergekit:
Passthrough:
Passthrough is a merging method where the embeddings or representations from multiple sources are concatenated or combined without any transformation or alignment.
🧩 Configuration
slices:
- sources:
- model: Suchinthana/Sinhala-Translate-and-Dolly-Llama-7b
layer_range: [0, 32]
- sources:
- model: austinm2151/Llama2-7b-Summarizer
layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- May 20, 2024
- Updated
- May 20, 2024