Downloads · 30 days
12
4% of all-time downloads
miqu-openhermes-full
alicecomfy/miqu-openhermes-full
miqu-openhermes-full is a text generation model from alicecomfy. Use it when you need the model to write or continue text. It is set up for transformers.
lora merge as it was really tricky to get it to work of https://huggingface.co/152334H/miqu-1-70b-hermes2.5-qlora.
All-time downloads
275
Public
Parameters
69B
138 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors138 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Feb 14, 2024
- Updated
- Feb 14, 2024
- SHA
- f3e4a8a1
Try a prompt
Model card
From the Hugging Face model README
lora merge as it was really tricky to get it to work of https://huggingface.co/152334H/miqu-1-70b-hermes2.5-qlora.
Base Model: Miqu 70B (Mistral AI Leak) Dequantized by 152234h Finetune also by 152234h
Outputs seem good, but the prompting is still a bit buggy, not sure if that's an error on my part.
For me it wouldn't generate text until I activated flash attention 2 in Oogabooga. You need around 130 GB vram, 2 a100 80 or h100 work, as does 6 3090 or 4090.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Feb 14, 2024
- Updated
- Feb 14, 2024