Downloads · 30 days
332
10% of all-time downloads
Endurance-100B-v1-GGUF
TheDrummer/Endurance-100B-v1-GGUF
Endurance-100B-v1-GGUF is a machine learning model from TheDrummer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
3.5K
Public
Repo size
606 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf606 GB · 100%
At a glance
- Access
- Public
- Created
- Dec 3, 2024
- Updated
- Dec 3, 2024
- SHA
- 07c50cab
Base models
Model card
From the Hugging Face model README
Join our Discord! https://discord.gg/Nbv9pQ88Xb
2500+ members strong 💪 Now with more channels! A hub for users and makers alike!
Endurance 100B v1 🎡
A finetune of Lazarus 2407 100B, a pruned Mistral Large 2407 123B!
Do not go gentle into that good night. Rage, rage against the dying of the light!
Links
- Original: https://huggingface.co/TheDrummer/Endurance-100B-v1
- GGUF: https://huggingface.co/TheDrummer/Endurance-100B-v1-GGUF
- iMatrix: https://huggingface.co/bartowski/Endurance-100B-v1-GGUF (recommended for smaller quants)
Arsenal (Supported Chat Templates)
- Metharme (Pygmalion in ST)
- Creative, unhinged, unique
Favorite RP Format
*action* Dialogue *thoughts* Dialogue *narration* in 1st person PoV
Favorite Card
Comparisons
| Quant | Experience | 123B | 100B | 72B |
|---|---|---|---|---|
| IQ2_XXS | Functional | 32.43GB | 26.61GB | 25.49GB |
| IQ3_XXS | Acceptable | 47.01GB | 38.54GB | 31.85GB |
| IQ4_XS | Good | 65.43GB | 53.64GB | 39.71GB |
Technical Details
Refer to Lazarus 2407 100B for pruning details.
Endurance used the same hyperparameters as Behemoth. Training loss indicates that they are exactly the same albeit with lower confidence.
Notes on Lazarus 100B (base model for Endurance):
- Testers have noted that 100B seemed nearly identical to 123B.
- One tester said that only one minor mistake was made by the model, requiring a rewrite for failing to pick up on the nuance.
- Another tester went through a satisfying 32K playthrough without any issues.
Endurance 100B v1.0 has gone through additional RP & Instruct training.
- Created
- Dec 3, 2024
- Updated
- Dec 3, 2024