Downloads · 30 days
16
25% of all-time downloads
Phi-3-Medium-128K-ATMa
Envoid/Phi-3-Medium-128K-ATMa
Phi-3-Medium-128K-ATMa is a text generation model from Envoid. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
All-time downloads
64
Public
Parameters
14B
27.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- phi3
- Access
- Public
- Created
- Jul 11, 2024
- Updated
- Jul 11, 2024
- SHA
- b98dac70
Try a prompt
Model card
From the Hugging Face model README
ATMa
Asymmetrically Tuned Matrix
This model is a very mid finetune of microsoft/Phi-3-medium-128k-instruct
Layers 1 through 15 were finetuned on one private dataset and then a LoRA of a different but similar and larger dataset was trained/applied to the entire model with a scaling factor of 1:4.
The results are mixed and it's hard to find a good use-case for this model.
All of the original scripts and code have been included in this repo.
Trained using qlora-pipe
- Task
- Text Generation
- Library
- transformers
- Type
- phi3
- License
- cc-by-nc-4.0
- Created
- Jul 11, 2024
- Updated
- Jul 11, 2024