Downloads · 30 days
37
5% of all-time downloads
Casual-Magnum-34B
Jacoby746/Casual-Magnum-34B
Casual-Magnum-34B is a machine learning model from Jacoby746. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
721
Public
Parameters
34.4B
68.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors68.8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Oct 1, 2024
- Updated
- Oct 29, 2024
- SHA
- 06ccc84f
Base models
Model card
From the Hugging Face model README
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SLERP merge method.
Models Merged
The following models were included in the merge:
- NeverSleep/CausalLM-RP-34B
- anthracite-org/magnum-v3-34b
Configuration
The following YAML configuration was used to produce this model:
models:
- model: ../models/anthracite-org_magnum-v3-34b
- model: ../models/NeverSleep_CausalLM-RP-34B
merge_method: slerp
base_model: ../models/NeverSleep_CausalLM-RP-34B
parameters:
t:
- value: [0, 0.1, 0.2, 0.4, 0.5, 0.6, 0.5, 0.4, 0.2, 0.1, 0]
embed_slerp: true
dtype: float16
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 23.57 |
| IFEval (0-Shot) | 19.30 |
| BBH (3-Shot) | 43.05 |
| MATH Lvl 5 (4-Shot) | 7.85 |
| GPQA (0-shot) | 16.33 |
| MuSR (0-shot) | 8.40 |
| MMLU-PRO (5-shot) | 46.49 |
- Type
- llama
- License
- apache-2.0
- Created
- Oct 1, 2024
- Updated
- Oct 29, 2024