Downloads · 30 days
1.3K
5% of all-time downloads
OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA
sayhan/OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA
OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA is a text generation model from sayhan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Finetuned by: sayhan - License: apache-2.0 - Finetuned from model : teknium/OpenHermes-2.5-Mistral-7B
All-time downloads
29.5K
Public
Parameters
7.2B
98.1 GB on disk
Likes
10
Public
Repo makeup
Click a slice to open those files.
.gguf69.1 GB · 70%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Feb 17, 2024
- Updated
- Feb 18, 2024
- SHA
- d82f3d8e
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
OpenHermes 2.5 Stix Philosophy Mistral 7B
- Finetuned by: sayhan
- License: apache-2.0
- Finetuned from model : teknium/OpenHermes-2.5-Mistral-7B
- Dataset: sayhan/strix-philosophy-qa
LoRA rank: 8
LoRA alpha: 16
LoRA dropout: 0
Rank-stabilized LoRA: Yes
Number of epochs: 3
Learning rate: 1e-5
Batch size: 2
Gradient accumulation steps: 4
Weight decay: 0.01
Target modules:
- Query projection (`q_proj`)
- Key projection (`k_proj`)
- Value projection (`v_proj`)
- Output projection (`o_proj`)
- Gate projection (`gate_proj`)
- Up projection (`up_proj`)
- Down projection (`down_proj`)
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Featherless Ai
- live
- Created
- Feb 17, 2024
- Updated
- Feb 18, 2024