Downloads · 30 days
22
33% of all-time downloads
EVA-Instruct-QwQ-32B-Preview-4bpw-h6-exl2
waldie/EVA-Instruct-QwQ-32B-Preview-4bpw-h6-exl2
EVA-Instruct-QwQ-32B-Preview-4bpw-h6-exl2 is a text generation model from waldie. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
All-time downloads
67
Public
Repo size
17.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen2
- Access
- Public
- Created
- Nov 30, 2024
- Updated
- Nov 30, 2024
- SHA
- 66d9575f
Try a prompt
Base models
Model card
From the Hugging Face model README
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using ParasiticRogue/EVA-Instruct-32B-v2 as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Qwen/QwQ-32B-Preview
parameters:
density: 1
weight: 1
- model: ParasiticRogue/EVA-Instruct-32B-v2
parameters:
density: 1
weight: 1
- model: Qwen/QwQ-32B-Preview
parameters:
density: 1
weight: 1
- model: ParasiticRogue/EVA-Instruct-32B-v2
parameters:
density: 1
weight: 1
merge_method: ties
base_model: ParasiticRogue/EVA-Instruct-32B-v2
parameters:
normalize: false
int8_mask: true
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- Created
- Nov 30, 2024
- Updated
- Nov 30, 2024