Downloads · 30 days
22
1% of all-time downloads
Phi-3-mini-4k-mango-2
rhysjones/Phi-3-mini-4k-mango-2
Phi-3-mini-4k-mango-2 is a text generation model from rhysjones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The Phi-3-mini-4k-mango-2 is a finetune of Phi-3-mini-4k-instruct with 4K context and 3.8B parameters.
All-time downloads
1.5K
Public
Parameters
3.8B
7.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- May 12, 2024
- Updated
- May 21, 2024
- SHA
- ccedd657
Model card
From the Hugging Face model README
Model Summary
The Phi-3-mini-4k-mango-2 is a finetune of Phi-3-mini-4k-instruct with 4K context and 3.8B parameters.
It is a continuaton of finetuning Phi-3 (which is a great model!) to explore its properties and behaviour. More to follow.
This version of the model has had its weight layers converted to Mistral format, allowing it to run within a Mistral toolset ecosystem without change or trust_remote_code. It seems to offer better performance than the eqivalent conversion to Llama format, which could be of interest to those using finetune toolsets yet to encompass the phi-3 model.
The process was first to convert the model weight names and config to Mistral, followed by a finetune of those weights.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- May 12, 2024
- Updated
- May 21, 2024