Downloads · 30 days
232
2% of all-time downloads
TinyllamaMix-1.1B
Aryanne/TinyllamaMix-1.1B
TinyllamaMix-1.1B is a text generation model from Aryanne. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This a TinyLlama mix merge, experimental, using a custom merge method. Should be better at RP.
All-time downloads
14.2K
Public
Parameters
1.1B
5.6 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf3.4 GB · 60%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 7, 2024
- Updated
- Mar 4, 2024
- SHA
- 72c59372
Model card
From the Hugging Face model README
This a TinyLlama mix merge, experimental, using a custom merge method. Should be better at RP.
merge_method: task_swapping
base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
models:
- model: cognitivecomputations/TinyDolphin-2.8.2-1.1b-laser
parameters:
weight: 0.75
diagonal_offset: 5
- model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
parameters:
weight: 0.85
diagonal_offset: 17
invert_offset: True
dtype: bfloat16
name: bye
---
merge_method: task_swapping
base_model: Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct
models:
- model: vihangd/DopeyTinyLlama-1.1B-v1
parameters:
weight: 0.8
diagonal_offset: 3
invert_offset: False
dtype: bfloat16
name: hello
---
merge_method: task_arithmetic
base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
models:
- model: hello
parameters:
weight: 0.66
- model: bye+Anarchist/PIPPA_LORA_TinyLlama
parameters:
weight: 0.5
dtype: bfloat16
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 32.99 |
| AI2 Reasoning Challenge (25-Shot) | 31.48 |
| HellaSwag (10-Shot) | 48.39 |
| MMLU (5-Shot) | 25.05 |
| TruthfulQA (0-shot) | 33.45 |
| Winogrande (5-shot) | 58.48 |
| GSM8k (5-shot) | 1.06 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Feb 7, 2024
- Updated
- Mar 4, 2024