Downloads · 30 days
2
5% of all-time downloads
SHARE-14B-Base-2604-8k_context
Joaoffg/SHARE-14B-Base-2604-8k_context
SHARE-14B-Base-2604-8k_context is a machine learning model from Joaoffg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This is a variation of the SHARE-14B-Base model that where context length was extended to 8192 tokens with 5000 documents. For all relevant details on the model, plese check the SHARE-14B-Base model card: https://hugg…
All-time downloads
37
Public
Parameters
14.1B
28.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors28.3 GB · 100%
At a glance
- License
- other
- Model type
- phi3
- Access
- Public
- Created
- Apr 10, 2026
- Updated
- Apr 14, 2026
- SHA
- 3bba26de
Model card
From the Hugging Face model README
General
This is a variation of the SHARE-14B-Base model that where context length was extended to 8192 tokens with 5000 documents. For all relevant details on the model, plese check the SHARE-14B-Base model card: https://huggingface.co/Joaoffg/SHARE-14B-Base-2604
Recommended use
We recommend using this version of the model exclusively for tasks that require a longer context length. Given that this context expansion was applied to an intermediate checkpoint, we did not spend enough compute to achieve comparable performance to the 4096 context model. Therefore, we advise use of the latter for most us cases.
Once model training is finalized, more robust long context versions of the model will be made available.
- Type
- phi3
- License
- other
- Languages
- en
- Created
- Apr 10, 2026
- Updated
- Apr 14, 2026