Downloads · 30 days
50
8% of all-time downloads
xxx777xxxASD/L3.1-ClaudeMaid-4x8B
L3.1-ClaudeMaid-4x8B is a text generation model from xxx777xxxASD. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
<style .image-container { position: relative; display: inline-block; }
Downloads · 30 days
50
8% of all-time downloads
All-time downloads
597
Public
Parameters
24.9B
49.9 GB on disk
Likes
7
Public
Click a slice to open those files.
.safetensors49.9 GB · 100%
From the Hugging Face model README
[!WARNING] GGUF
Experimental RP-oriented MoE
base_model: NeverSleep_Lumimaid-v0.2-8B
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: aifeifei798_DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored
- source_model: Nitral-AI_Sekhmet_Bet-L3.1-8B-v0.2
- source_model: NeverSleep_Lumimaid-v0.2-8B
- source_model: Undi95_Meta-Llama-3.1-8B-Claude-bf16
It seems like 1.71 koboldcpp can't run GGUFs of llama-3.1 MoE models yet, or perhaps im just dumb and messed something up.
If anyone has similar problem - run the model directly from llama.cpp, here's simple open source GUI(Windows) you can use if the console is your worst enemy

UPDATE 28.07.2024 Try this koboldcpp version