Downloads · 30 days
2
1% of all-time downloads
LMCocktail-10.7B-v1-3.0bpw-h6-exl2
LoneStriker/LMCocktail-10.7B-v1-3.0bpw-h6-exl2
LMCocktail-10.7B-v1-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is a 50%-50% model of the SOLAR model and meow.
All-time downloads
232
Public
Repo size
4.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Dec 20, 2023
- Updated
- Dec 20, 2023
- SHA
- 0aea0759
Try a prompt
Model card
From the Hugging Face model README
LM-cocktail 10.7B v1
This is a 50%-50% model of the SOLAR model and meow.
https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0
https://huggingface.co/rishiraj/meow
who rank #1 and #2 among models <13B in the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard by 2023/12/20.
Code
The LM-cocktail is novel technique for merging multiple models https://arxiv.org/abs/2311.13534
Code is backed up by this repo https://github.com/FlagOpen/FlagEmbedding.git
Merging scripts available under the ./scripts folder
Result
The SOLAR model is the first model <30B that can answer this question from my test:
What will AI be like in the year 1010 A.D?
without hullicinating into 1010 A.D is a future time (like other llama2 models)
Models greater than that, like Yi-34B could answer this paradoxic question correctly as well, since it is huge enough.
SOLAR 10.7B output
LMCocktail 10.7B output1
LMCocktail 10.7B output2
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Dec 20, 2023
- Updated
- Dec 20, 2023