Downloads · 30 days
83
0% of all-time downloads
FusionNet_passthrough_v0.1
TomGrc/FusionNet_passthrough_v0.1
FusionNet_passthrough_v0.1 is a text generation model from TomGrc. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Fine-tuned model on English language using single passthrough Fusion method. The FusionNet is a model to experiment with the single passthrough Fusion method, which could significantly increase the performance of the…
All-time downloads
37.7K
Public
Parameters
21.2B
42.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors42.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Jan 1, 2024
- Updated
- Mar 4, 2024
- SHA
- 29ca1189
Try a prompt
Model card
From the Hugging Face model README
FusionNet
Fine-tuned model on English language using single passthrough Fusion method.
Model description
The FusionNet is a model to experiment with the single passthrough Fusion method, which could significantly increase the performance of the original model. The FusionNet has 21.2B parameters, and this model is fine-tuned. Enjoy!
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 65.74 |
| AI2 Reasoning Challenge (25-Shot) | 69.45 |
| HellaSwag (10-Shot) | 87.79 |
| MMLU (5-Shot) | 65.20 |
| TruthfulQA (0-shot) | 67.67 |
| Winogrande (5-shot) | 81.53 |
| GSM8k (5-shot) | 22.82 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Jan 1, 2024
- Updated
- Mar 4, 2024