Downloads · 30 days
20
7% of all-time downloads
Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw
PhilipMay/Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw
Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw is a text generation model from PhilipMay. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The is a 8x MoE version of microsoft/Phi-3-mini-4k-instruct. It is based on the Llamafied version vonjack/Phi-3-mini-4k-instruct-LLaMAfied of Gan Feng.
All-time downloads
300
Public
Parameters
20.7B
41.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors41.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Apr 27, 2024
- Updated
- Jun 2, 2024
- SHA
- 26b3038e
Try a prompt
Model card
From the Hugging Face model README
Phi-3 MoE mini 4k instruct raw
The is a 8x MoE version of microsoft/Phi-3-mini-4k-instruct. It is based on the Llamafied version vonjack/Phi-3-mini-4k-instruct-LLaMAfied of Gan Feng.
It was created with the help of mergekit.
As the router was initialized randomly during merging, this is a raw model. It should be trained before it can be used.
Licensing
Copyright (c) 2024 Philip May
Copyright (c) Gan Feng
Copyright (c) Microsoft Corporation
Licensed under the MIT License (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License by reviewing the file LICENSE in the repository.
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Created
- Apr 27, 2024
- Updated
- Jun 2, 2024