Downloads · 30 days
32
39% of all-time downloads
FalconNet/Phi-3.5-mini-32K-output
Phi-3.5-mini-32K-output is a text generation model from FalconNet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Developed by: FalconNet - License: apache-2.0 - Finetuned from model: unsloth/phi-3.5-mini-instruct-bnb-4bit - Dataset used to Finetune: THUDM/LongWriter-6k
Downloads · 30 days
32
39% of all-time downloads
All-time downloads
82
Public
Parameters
3.8B
15.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.bin7.6 GB · 50%
From the Hugging Face model README
THUDM/LongWriter dataset contains 6,000 SFT data with ultra-long output ranging from 2k-32k words in length (both English and Chinese). The data can support training LLMs to extend their maximum output window size to 10,000+ words - used in this model
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.