Downloads · 30 days
23
0% of all-time downloads
Yi-34b-x2-v2
sumo43/Yi-34b-x2-v2
Yi-34b-x2-v2 is a text generation model from sumo43. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Yi-32b-x2-v2.0 is an MoE model created with mergekit + custom prompts. The following base models are used:
All-time downloads
7.2K
Public
Parameters
60.8B
122 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors122 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Jan 17, 2024
- Updated
- Jan 18, 2024
- SHA
- f9274f0d
Try a prompt
Model card
From the Hugging Face model README
Introduction
Yi-32b-x2-v2.0 is an MoE model created with mergekit + custom prompts. The following base models are used:
Weyaxi/Bagel-Hermes-34B-Slerp
one-man-army/UNA-34Beagles-32K-bf16-v1
Details
Used Librarys
- mergekit
- transformers
How to use
# pip install transformers==4.35.2
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("sumo43/Yi-32b-x2-v2.0")
model = AutoModelForCausalLM.from_pretrained(
"sumo43/Yi-32b-x2-v2.0"
)
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- en
- Created
- Jan 17, 2024
- Updated
- Jan 18, 2024